Disclaimer: The purpose of the Open Case Studies project is to demonstrate the use of various data science methods, tools, and software in the context of messy, real-world data. A given case study does not cover all aspects of the research process, is not claiming to be the most appropriate way to analyze a given data set, and should not be used in the context of making policy decisions without external consultation from scientific experts.

This work is licensed under the Creative Commons Attribution-NonCommercial 3.0 (CC BY-NC 3.0) United States License.

Motivation

This case study will introduce the topic of multicolinearity. We will do so by showcasing a real world example where multicolinearity in part resulted in historically contriversial and conflicting findings about the influence of the adoption of right-to-carry (RTC) concealed handgun laws on violent crime rates in the United States.

We will focus on two articles:

The first analysis by Lott and Mustard published in 1996 suggests that RTC laws reduce violent crime. Lott authored a book extending these findings in 1998 called More Guns, Less Crime.

The second analysis is a recent article by Donohue, et al. published in 2017 that suggests that RTC laws increase violent crime. Donohue has also published previous articles with titles such as “Shooting down the”More Guns, Less Crime" Hypothesis

This has been a controversial topic as many other articles also had conflicting results. See here for a list of studies.

The Donohue, et al. article discusses how there are many other important methodolical aspects besides multicolinearity that could account for the historically conflicting results in these previous papers.

In fact, nearly every aspect of the data analysis process was different between the Donohue, et al. analysis and the Lott and Mustard analysis.

However, we will focus particularly on multicolinearity and we will explore how it can influence linear regression analyses and result in different conclusions.

This analysis will demonstrate how methodological details can be critically influential for our overall conclusions and can result in important policy related consequences. This article will provide a basis for the motivation.

John J. Donohue et al., Right‐to‐Carry Laws and Violent Crime: A Comprehensive Assessment Using Panel Data and a State‐Level Synthetic Control Analysis. Journal of Empirical Legal Studies, 16,2 (2019).

David B. Mustard & John Lott. Crime, Deterrence, and Right-to-Carry Concealed Handguns. Coase-Sandor Institute for Law & Economics Working Paper No. 41, (1996).

Here you can see the differences in the data used in the featured RTC articles:

We will perform analyses similar to those in these articles, however we will not try to recreate them, instead we will simplify our analysis to allow us to focus on multicolinearity.

Therefore we will use a subset of the listed explanatory variables and they will be consistent for both analyses that we will perform, with the exception that one analysis will have 6 demographic variables like the analysis in the Donohue, et al. article and the other will have 36 demogrpahic variables like the analysis in the Lott and Mustard article.

Main Question

Our main question:

How does the inclusion of different numbers of age groups influence the results of an analysis of right to carry laws and violence rates?

Learning Objectives

Statistical Learning Objectives:

what multicollinearity is and how it can influence linear regression coefficients
how to look for the presence of multicollinarity and determine the severity
the difference between multicollinearity and correlation

Data science Learning Objectives:

data import of many different file types with special cases (readr, readxl, pdftools)
joining data from multiple sources (dplyr)
working with character strings (stringr)
data comparisons (dplyr and janitor)
reshaping data into different formats (tidyr)
visualizations (ggplot2)
perform iterative simulations (rsample)

We will especially focus on using packages and functions from the Tidyverse, such as dplyr and ggplot2. The tidyverse is a library of packages created by RStudio. While some students may be familiar with previous R programming packages, these packages make data science in R especially efficient.

Context

So what exactly is a right-to-carry law?

It is a law thatspecifies if and how citizens are allowed to have a firearm on their person or nearby (for example in the citizen’s car) in public.

The Second Amendment to the United States Constitution guarantees the right to “keep and bear arms”. The amendment was ratified in 1791 as part of the Bill of Rights.

However, there are no federal laws about carrying firearms in public.

These laws are created and enforced at the state level. Sates vary greatly in their laws about the right to carry firearms. Some require extensive effort to obtain a permit to legally carry a firearm, while other states require very minimal effort to legally carry a firearm.

According to Wikipedia about the history of right-to-carry policies in the United States:

Public perception on concealed carry vs open carry has largely flipped. In the early days of the United States, open carrying of firearms, long guns and revolvers was a common and well-accepted practice. Seeing guns carried openly was not considered to be any cause for alarm. Therefore, anyone who would carry a firearm but attempt to conceal it was considered to have something to hide, and presumed to be a criminal. For this reason, concealed carry was denounced as a detestable practice in the early days of the United States.

Concealed weapons bans were passed in Kentucky and Louisiana in 1813. (In those days open carry of weapons for self-defense was considered acceptable; concealed carry was denounced as the practice of criminals.) By 1859, Indiana, Tennessee, Virginia, Alabama, and Ohio had followed suit. By the end of the nineteenth century, similar laws were passed in places such as Texas, Florida, and Oklahoma, which protected some gun rights in their state constitutions. Before the mid 1900s, most U.S. states had passed concealed carry laws rather than banning weapons completely. Until the late 1990s, many Southern states were either “No-Issue” or “Restrictive May-Issue”. Since then, these states have largely enacted “Shall-Issue” licensing laws, with numerous states legalizing “Unrestricted concealed carry”.

See here for more information.

Here are the general categories of Right to Carry Laws:

source

You can see that none of the fifty states have no-issue laws currently (the gray category), meaning that all states allow the right to carry firearms at least in some way, however the level of restrictions is dramatically different from one state to another.

Here you can see how these laws have changed over time around the country:

There is variation from state to state even within the same general category:

For example here are the current carry laws in Idaho which is considered an “Unrestricted - no permit required” state:

Idaho permits the open carrying of firearms.

Idaho law permits both residents and non-residents who are at least 18 years old to carry concealed weapons, without a carry license, outside the limits of or confines of any city, provided the person is not otherwise disqualified from being issued a license to carry.

A person may also carry concealed weapons on or about his or her person, without a license, in the person’s own place of abode or fixed place of business, on property in which the person has any ownership or leasehold interest, or on private property where the person has permission to carry from any person who has an ownership or leasehold interest in that property.

State law also allows any resident of Idaho or a current member of the armed forces of the United States to carry a concealed handgun without a license to carry, provided the person is over 18 years old and not disqualified from being issued a license to carry concealed weapons under state law. An amendment to state law that takes effect on July 1, 2020 changes the reference in the above law from “a resident of Idaho” to “any citizen of the United States.”

And here are the current carry laws in Arizona which is also considered an “Unrestricted - no permit required” state:

Arizona respects the right of law abiding citizens to openly carry a handgun.

Any person 21 years of age or older, who is not prohibited possessor, may carry a weapon openly or concealed without the need for a license. Any person carrying without a license must acknowledge and comply with the demands of a law enforcement officer when asked if he/she is carrying a concealed deadly weapon, if the officer has initiated an “investigation” such as a traffic stop.

Notice that citizens in Idaho only need to be 18 to carry a firearm, whereas they must be 21 in Arizona.

In contrast here is an example of current carry laws in Maryland which is considered a “Rights Restricted-Very Limited Issue” state:

Carrying and Transportation in Vehicles It is unlawful for any person without a permit to wear or carry a handgun, openly or concealed, upon or about his person. It is also unlawful for any person to knowingly transport a handgun in any vehicle traveling on public roads, highways, waterways or airways, or upon roads or parking lots generally used by the public. This does not apply to any person wearing, carrying or transporting a handgun within the confines of real estate owned or leased by him, or on which he resides, or within the confines of a business establishment owned or leased by him.

Permit To Carry Application for a permit to carry a handgun is made to the Secretary of State Police. In addition to the printed application form, the applicant should submit a notarized letter stating the reasons why he is applying for a permit.

avocado….Right to carry and covid masks?

Limitations

There are some important considerations regarding this data analysis to keep in mind:

We do not use all of the data used by either the Lott and Mustard or Donohue, et al. analyses, nor do we perform the same analysis of each article. We instead perform a much simpler analysis with less variables for the purposes of illustration of the concept of multicollinearity and its influence on regression coefficients, not to reproduce either analysis.
Our analysis accounts for either the adoption or lack of adoption of a permissive right-to-carry law in each state, but does not acount for differences in the level of permissiveness of the laws.

Recall that these are the categories of right to carry laws: States with laws of the category rights restricted - very limited issue (red) are considered as not having a permissive right-to-carry law. Recall that no states currently have a rights infringed/non-issue law.

States of all other categories (shall issue, discretionary/reasonable issue, and no permit required) (all shades of blue) are considered the same in our analysis, as having a permissive right-to-carry law.

Because our analysis is an oversimplification, our analysis should not be used for determining policy changes, instead we suggest that users consult with a specialist.

We would also like to note that…AVOCADO It is important that we do not treat race as an objective measure. Despite this, it can be used to advance scientific inquiry. For more information on this topic, we have included a link to a paper on the use of race as a measure in epidemiology.

We will begin by loading the packages that we will need:

library(here)
library(readxl)
library(readr)
library(pdftools)
library(dplyr)
library(magrittr)
library(tidyr)
library(stringr)
library(purrr)
library(forcats)
library(tibble)
library(car) # vif function
library(plm) # fixed effect model, linear regression
library(broom) # tidy output
library(cowplot) # to produce plot of plots 
library(GGally)
library(ggrepel)
library(scales)
library(latex2exp)
library(viridis)
library(ggcorrplot)
library(rsample)

set.seed(999)

Package	Use
here	to easily load and save data
readr	to import the CSV file data
[car]	to calculate vif values
[purrr]	to combine multiple tibbles within a list of tibbles
[forcats]	to collapse levels of factors into more summarised versions

The first time we use a function, we will use the :: to indicate which package we are using. Unless we have overlapping function names, this is not necessary, but we will include it here to be informative about where the functions we will use come from.

What are the data?

Below is a table from the Donohue, et al. paper that shows the data used in both analyses, where DAW stands for Donohue, et al. and LM stands for Lott and Mustard.

We will be using a subset of these variables, which are highlighted in green:

Data Import

Demographic and population data

To obtain information about age, sex, and race, and overall population we will use US Census Bureau data, just like both of the articles. The cesnus data is available for different time spans. Here are the links for the years used in our analysis. We will use data from 1977 to 2010.

Data	Link
years 1977 to 1979	link
years 1980 to 1989	link * county data was used for this decade which also has state information
years 1990 to 1999	link
years 2000 to 2010	link technical documentation

To import the data we will use the read_csv() function of the readr package for the csv files. In some decades, there are separate files for each year, we will read each of these together using the base list.files() function to get all of the names for each file and then the map() function of the purrr package to apply the read_csv() function on all of the file paths in the list created by list.files(). For years that are txt files we will use read_table2() also fo the readr package. The read_table2() function, unlike the read_table(), allows for any number of whitespace characters between columns, and the lines can be of different lengths.

AVOCADO I am a bit confused about the last decade… it’s only one file but it seems to need map…

dem_77_79 <- read_csv("docs/Demographics/Decade_1970/pe-19.csv", skip = 5)

dem_80_89 <- list.files(recursive = TRUE,
                  path = "docs/Demographics/Decade_1980/",
                  pattern = "*.csv",
                  full.names = TRUE) %>% 
  map(~read_csv(., skip=5))

dem_90_99 <- list.files(recursive = TRUE,
                  path = "docs/Demographics/Decade_1990/",
                  pattern = "*.txt",
                  full.names = TRUE) %>% 
  map(~read_table2(., skip = 14))


dem_00_10_2 <- read_csv("docs/Demographics/Decade_2000/st-est00int-alldata.csv")

dem_00_10 <- list.files(recursive = TRUE,
                  path = "docs/Demographics/Decade_2000/",
                  pattern = "*.csv",
                   full.names = TRUE) %>% 
   map(~read_csv(.))

head(dem_00_10)

[[1]]
# A tibble: 62,244 x 21
   REGION DIVISION STATE NAME    SEX ORIGIN  RACE AGEGRP ESTIMATESBASE20…
    <dbl>    <dbl> <dbl> <chr> <dbl>  <dbl> <dbl>  <dbl>            <dbl>
 1      0        0     0 Unit…     0      0     0      0        281424600
 2      0        0     0 Unit…     0      0     0      1         19176154
 3      0        0     0 Unit…     0      0     0      2         20549855
 4      0        0     0 Unit…     0      0     0      3         20528425
 5      0        0     0 Unit…     0      0     0      4         20218782
 6      0        0     0 Unit…     0      0     0      5         18962964
 7      0        0     0 Unit…     0      0     0      6         19381792
 8      0        0     0 Unit…     0      0     0      7         20511067
 9      0        0     0 Unit…     0      0     0      8         22707390
10      0        0     0 Unit…     0      0     0      9         22442442
# … with 62,234 more rows, and 12 more variables: POPESTIMATE2000 <dbl>,
#   POPESTIMATE2001 <dbl>, POPESTIMATE2002 <dbl>, POPESTIMATE2003 <dbl>,
#   POPESTIMATE2004 <dbl>, POPESTIMATE2005 <dbl>, POPESTIMATE2006 <dbl>,
#   POPESTIMATE2007 <dbl>, POPESTIMATE2008 <dbl>, POPESTIMATE2009 <dbl>,
#   CENSUS2010POP <dbl>, POPESTIMATE2010 <dbl>

Notice that the STATE variable for the demographic data is numeric. That is because it is encoded by Federal Information Processing Standard (FIPS) state codes{target="_blank". Thus we also need to import data about FIPS encoding so that we can identify what data corresponds to what state.

State FIPS codes

The following data was downloaded from the US Census Bureau.

To import the data we will use the read_xls() function of the readxl package. Since the first five lines of this excel is information about the source of the data and when it was released, we need to skip importing these lines using the skip argument so that the data has the same number of columns for each row.

knitr::include_graphics(here("img", "FIPS.png"))

STATE_FIPS <- read_xls("docs/State_FIPS_codes/state-geocodes-v2014.xls", skip = 5)
(STATE_FIPS)

# A tibble: 64 x 4
   Region Division `State\n(FIPS)` Name                    
   <chr>  <chr>    <chr>           <chr>                   
 1 1      0        00              Northeast Region        
 2 1      1        00              New England Division    
 3 1      1        09              Connecticut             
 4 1      1        23              Maine                   
 5 1      1        25              Massachusetts           
 6 1      1        33              New Hampshire           
 7 1      1        44              Rhode Island            
 8 1      1        50              Vermont                 
 9 1      2        00              Middle Atlantic Division
10 1      2        34              New Jersey              
# … with 54 more rows

Police staffing data

The following data was downloaded from the Federal Bureau of Investigation.

The read_csv() function of the readr package guesses what the class is for each variable, but sometimes it makes mistakes. It is good to specify the class for variables if you know them. We know that we want the variables about male and female counts to be numeric. We can specify that using the col_types = argument. See here and here for more information.

ps_data <- read_csv("docs/Police_staffing/pe_1960_2018.csv")
ps_data <- read_csv("docs/Police_staffing/pe_1960_2018.csv",
                    col_types = cols(male_total_ct = "n",
                                     female_total_ct = "n"))

ps_data <- read_csv("docs/Police_staffing/pe_1960_2018.csv",
                   col_types =  cols(male_total_ct = col_double(),
                                   female_total_ct = col_double()))
head(ps_data)

# A tibble: 6 x 21
  data_year ori   pub_agency_name pub_agency_unit state_abbr division_name
      <dbl> <chr> <chr>           <chr>           <chr>      <chr>        
1      1960 AK02… Alcohol Bevera… <NA>            AK         Pacific      
2      1960 AL00… Homewood        <NA>            AL         East South C…
3      1960 AL01… Coffeeville     <NA>            AL         East South C…
4      1960 AL01… Coffee          <NA>            AL         East South C…
5      1960 AL02… Mentone         <NA>            AL         East South C…
6      1960 AL03… Greensboro      <NA>            AL         East South C…
# … with 15 more variables: region_name <chr>, county_name <chr>,
#   agency_type_name <chr>, population_group_desc <chr>, population <dbl>,
#   male_officer_ct <dbl>, male_civilian_ct <dbl>, male_total_ct <dbl>,
#   female_officer_ct <lgl>, female_civilian_ct <lgl>, female_total_ct <dbl>,
#   officer_ct <lgl>, civilian_ct <lgl>, total_pe_ct <lgl>,
#   pe_ct_per_1000 <lgl>

Unemplyment data

The following data was downloaded from the U.S. Bureau of Labor Statistics.

There are excel files for each state. As you can see, there are many rows to skip to make sure that there are the same number of columns for each row. We can also see that the state name is located in a couple of the first rows.

knitr::include_graphics(here("img", "Unemp.png"))

We can also see that here if we just try to read in the files directly.

ue_rate_data <- list.files(recursive = TRUE,
                  path = "docs/Unemployment",
                  pattern = "*.xlsx",
                  full.names = TRUE) %>% 
  map(~read_xlsx(.))
      
head(ue_rate_data)[1]

[[1]]
# A tibble: 55 x 14
   `Local Area Une… ...2  ...3  ...4  ...5  ...6  ...7  ...8  ...9  ...10 ...11
   <chr>            <chr> <chr> <chr> <chr> <chr> <chr> <chr> <chr> <chr> <chr>
 1 Original Data V… <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 2 <NA>             <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 3 Series Id:       LAUS… <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 4 Not Seasonally … <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 5 Area:            Alab… <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 6 Area Type:       Stat… <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 7 State/Region/Di… Alab… <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 8 Measure:         unem… <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
 9 Years:           1977… <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
10 <NA>             <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA>  <NA> 
# … with 45 more rows, and 3 more variables: ...12 <chr>, ...13 <chr>,
#   ...14 <chr>

So now we will skip the first 10 lines. And also create a names tibble that contains only the cell with the state information.

 ue_rate_data <- list.files(recursive = TRUE,
                  path = "docs/Unemployment",
                  pattern = "*.xlsx",
                  full.names = TRUE) %>% 
  map(~read_xlsx(., skip = 10))
  
head(ue_rate_data[1])

[[1]]
# A tibble: 44 x 14
    Year   Jan   Feb   Mar   Apr   May   Jun   Jul   Aug   Sep   Oct   Nov   Dec
   <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl>
 1  1977   7.5   9     7.7   7.2   6.8   8.6   8     7.8   6.7   6.3   6.3   6  
 2  1978   7.1   6.9   6.2   5.4   5.1   6.9   6.7   6.7   6.5   6.3   6.3   6.5
 3  1979   6.7   7.5   6.9   6.6   6.4   8.4   7.7   7.8   7.1   7.2   6.9   6.7
 4  1980   7.7   7.8   7.4   7.4   8.4   9.7  10.4  10.3   9.3   9.6   9.4   9  
 5  1981  10    10.3   9.5   9.1   9.4  11.1  10.4  10.9  10.8  11.7  11.5  11.8
 6  1982  13.2  13.2  12.9  12.6  12.8  14.5  14.7  14.8  14.7  15.1  15.4  15.3
 7  1983  16    16    14.5  13.7  13.3  14.6  13.9  13.8  13.2  12.8  12.1  11.8
 8  1984  12.5  12.4  11.4  10.8  10.1  11.3  11.5  11.3  10.8  10.2   9.7  10.1
 9  1985  10.7  10.5   9.8   8.7   8.4   9.6   9.2   8.8   8.6   8.6   8.4   8.7
10  1986   9.3  10.4  10.1   9.4   9.4  10.5   9.7   9.6   9.7   9.7   9.6   9  
# … with 34 more rows, and 1 more variable: Annual <dbl>

To get the state name for each file using the map() function to perform functions across all of the files, we will specifically import only a small range of cells using the range = argument and then grab the cell that has state information based on it’s location within the range of cells imported using c() and then use the base unlist() function to unlist the list that this creates.

ue_rate_names <- list.files(recursive = TRUE,
                  path = "docs/Unemployment",
                  pattern = "*.xlsx",
                  full.names = TRUE) %>%
  map(~read_xlsx(., range = "B4:B6")) %>%
  map(., c(1,2)) %>%
  unlist()

ue_rate_names

 [1] "Alabama"              "Alaska"               "Arizona"             
 [4] "Arkansas"             "California"           "Colorado"            
 [7] "Connecticut"          "Delaware"             "District of Columbia"
[10] "Florida"              "Georgia"              "Hawaii"              
[13] "Idaho"                "Illinois"             "Indiana"             
[16] "Iowa"                 "Kansas"               "Kentucky"            
[19] "Louisiana"            "Maine"                "Maryland"            
[22] "Massachusetts"        "Michigan"             "Minnesota"           
[25] "Mississippi"          "Missouri"             "Montana"             
[28] "Nebraska"             "Nevada"               "New Hampshire"       
[31] "New Jersey"           "New Mexico"           "New York"            
[34] "North Carolina"       "North Dakota"         "Ohio"                
[37] "Oklahoma"             "Oregon"               "Pennsylvania"        
[40] "Rhode Island"         "South Carolina"       "South Dakota"        
[43] "Tennessee"            "Texas"                "Utah"                
[46] "Vermont"              "Virginia"             "Washington"          
[49] "West Virginia"        "Wisconsin"            "Wyoming"

Now we will make these values the names of the different tibbles within ue_rate_data.

names(ue_rate_data) <- ue_rate_names

Poverty data

Extracted from Table 21 from US Census Bureau Poverty Data

AVOCado strange issue

#**persistent warning from unknown origin** https://community.rstudio.com/t/persistent-unknown-or-uninitialised-column-warnings/64879

#solution to above is alledgedly: "In any case the suggested approach is to initialize the column"


poverty_rate_data <- read_xls("docs/Poverty/hstpov21.xls", skip=2) #This may cause initialization issue, not easily reproducible (even after restarting R)

head(poverty_rate_data)

# A tibble: 6 x 6
  `NOTE: Number in thousa… ...2  ...3   ...4         ...5         ...6          
  <chr>                    <chr> <chr>  <chr>        <chr>        <chr>         
1 2018                     <NA>  <NA>    <NA>        <NA>          <NA>         
2 STATE                    Total Number "Standard\n… Percent      "Standard\ner…
3 Alabama                  4877  779    "65"         16           "1.3"         
4 Alaska                   720   94     "9"          13.1         "1.2"         
5 Arizona                  7241  929    "80"         12.80000000… "1.1000000000…
6 Arkansas                 2912  462    "38"         15.9         "1.3"

We can see that this will require some wranlging to make the data more usable.

Violent crime

Violent crime data was obtained from here This data is a bit trickier because of spaces and / in the column names, thus the read_lines() function of the readr package works better than the read_csv() function.

knitr::include_graphics(here("img", "crime.png"))

crime_data <- read_lines("docs/Crime/CrimeStatebyState.csv", skip = 2, skip_empty_rows = TRUE)
head(crime_data)

[1] "Estimated crime in Alabama"                                                                                                           
[2] "\n,,National or state crime,,,,,,,"                                                                                                   
[3] "\n,,Violent crime,,,,,,,"                                                                                                             
[4] "\nYear,Population,Violent crime total,Murder and nonnegligent Manslaughter,Legacy rape /1,Revised rape /2,Robbery,Aggravated assault,"
[5] "1977,   3690000,      15293,         524,         929,,       3572,      10268 "                                                      
[6] "1978,   3742000,      15682,         499,         954,,       3708,      10521 "

We can see that this data will also require some wranlging to make it more usable.

Right-to-carry data

This data is extracted from table in Donohue paper {target="_blank"}. We will use the function pdf_text() of the pdftools package to import the pdf document.

if(!file.exists(here("docs", "w23510.pdf"))){
  url <- "https://www.nber.org/papers/w23510.pdf"
  utils::download.file(url, here("docs", "w23510.pdf"))
}

DAWpaper <- pdf_text(here("docs", "w23510.pdf"))

head(DAWpaper[1])

[1] "                                NBER WORKING PAPER SERIES\n                      RIGHT-TO-CARRY LAWS AND VIOLENT CRIME:\n              A COMPREHENSIVE ASSESSMENT USING PANEL DATA AND\n                    A STATE-LEVEL SYNTHETIC CONTROL ANALYSIS\n                                          John J. Donohue\n                                            Abhay Aneja\n                                           Kyle D. Weber\n                                         Working Paper 23510\n                                 http://www.nber.org/papers/w23510\n                      NATIONAL BUREAU OF ECONOMIC RESEARCH\n                                     1050 Massachusetts Avenue\n                                        Cambridge, MA 02138\n                                 June 2017, Revised November 2018\nPreviously circulated as \"Right-to-Carry Laws and Violent Crime: A Comprehensive Assessment\nUsing Panel Data and a State-Level Synthetic Controls Analysis.\" We thank Dan Ho, Stefano\nDellaVigna, Rob Tibshirani, Trevor Hastie, StefanWager, Jeff Strnad, and participants at the\n2011 Conference of Empirical Legal Studies (CELS), 2012 American Law and Economics\nAssociation (ALEA) Annual Meeting, 2013 Canadian Law and Economics Association (CLEA)\nAnnual Meeting, 2015 NBER Summer Institute (Crime), and the Stanford Law School faculty\nworkshop for their comments and helpful suggestions. Financial support was provided by\nStanford Law School. We are indebted to Alberto Abadie, Alexis Diamond, and Jens\nHainmueller for their work developing the synthetic control algorithm and programming the Stata\nmodule used in this paper and for their helpful comments. The authors would also like to thank\nAlex Albright, Andrew Baker, Jacob Dorn, Bhargav Gopal, Crystal Huang, Mira Korb, Haksoo\nLee, Isaac Rabbani, Akshay Rao, Vikram Rao, Henrik Sachs and Sidharth Sah who provided\nexcellent research assistance, as well as Addis O’Connor and Alex Chekholko at the Research\nComputing division of Stanford’s Information Technology Services for their technical support.\nThe views expressed herein are those of the author and do not necessarily reflect the views of the\nNational Bureau of Economic Research.\nNBER working papers are circulated for discussion and comment purposes. They have not been\npeer-reviewed or been subject to the review by the NBER Board of Directors that accompanies\nofficial NBER publications.\n© 2017 by John J. Donohue, Abhay Aneja, and Kyle D. Weber. All rights reserved. Short\nsections of text, not to exceed two paragraphs, may be quoted without explicit permission\nprovided that full credit, including © notice, is given to the source.\n"

Again, this data will also require quite a bit of wrangling.

Data Wrangling

State FIPS codes

Let’s first take a look at our state FIPS data to see if it needs any cleaning or reshaping. We should start with this data, becuase we will need to use it to wrangle some of the other data.

head(STATE_FIPS)

# A tibble: 6 x 4
  Region Division `State\n(FIPS)` Name                
  <chr>  <chr>    <chr>           <chr>               
1 1      0        00              Northeast Region    
2 1      1        00              New England Division
3 1      1        09              Connecticut         
4 1      1        23              Maine               
5 1      1        25              Massachusetts       
6 1      1        33              New Hampshire

We only need the last two columns, but we might want to rename them. The Name variable is vague. The variable with the FIPS code is called State\n(FIPS). To get rid of the new line in this variable name and to change the Name variable to something more informative, we will use the rename() function of the dplyr package. To use this function, we need to list the new name first followed by = and then the existing variable. We can rename multiple variables at the same time by using a comma to separate the variables we are renaming. We will use the select() function also of the dplyr package just to keep these variables, and we will filter out the rows with FIPS values of 00 with the filter() function, agian also part of the dplyr package. we will specify that we want STATEFP values that are not equal to 00 by using this operator: !=. We will also use the double pipe operator %<>% of the magrittr package which allows us to use data as iuput and then reassign it after we peform sum functions using it.

STATE_FIPS %<>% 
dplyr::rename( STATEFP = `State\n(FIPS)`,
                 STATE = Name) %>%
    dplyr::select(STATEFP, STATE) %>%
    dplyr::filter(STATEFP != "00")

STATE_FIPS

# A tibble: 51 x 2
   STATEFP STATE        
   <chr>   <chr>        
 1 09      Connecticut  
 2 23      Maine        
 3 25      Massachusetts
 4 33      New Hampshire
 5 44      Rhode Island 
 6 50      Vermont      
 7 34      New Jersey   
 8 36      New York     
 9 42      Pennsylvania 
10 17      Illinois     
# … with 41 more rows

Demographic and population data

Click here to see detailed information about how the demogrphic data was wrangled

1977-1979

Now let’s take a look at our demographic data across the decades that we wish to study. If you have very wide data (meaning it has many columns), one way to view the data so that you can see all of the columns at the same time is to use the glimpse() function of the dplyr package.

Taking a look at the first decade of data, we can see that the Race/Sex Indicator contains two types of data, the race and the sex. This does not follow the tidy data philosophy, where each cell of a tibble should only contain one piece of information. Typically one might think of using the separate() function of the tidyr package to split this variable into two. However, one of the race values is Other races and since this also has a space, this makes separating this data more tricky.

Instead we will use the str_extract() function of the stringr package and the mutate() function of the dplyr package. The “mutate()” will allow us to create new variables, and “str_extract()” function will allow us to match specific patterns and pull out matches to those patterns. Therefore, if the Race/Sex Indicator value is Other races male and if we extract patterns matching either "male" or "female" which we can specify like this pattern = "male|female" then, the value will be male.

First we need to rename the Race/Sex Indicator varaible to not have spaces so that it is compatible with the str_extract() function.

We also want to rename a couple of variables to be simpler and filter the data to only include the years of the data we are interested in, as well as remove some variables that we dont need like the FIPS State Code. We can remove variables by using the select() function with a - minus sign in front of the variable we wish to remove.

dplyr::glimpse(dem_77_79)

Rows: 3,060
Columns: 22
$ `Year of Estimate`   <dbl> 1970, 1970, 1970, 1970, 1970, 1970, 1970, 1970, …
$ `FIPS State Code`    <chr> "01", "01", "01", "01", "01", "01", "02", "02", …
$ `State Name`         <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Ala…
$ `Race/Sex Indicator` <chr> "White male", "White female", "Black male", "Bla…
$ `Under 5 years`      <dbl> 105856, 100613, 47403, 47079, 244, 250, 12382, 1…
$ `5 to 9 years`       <dbl> 120876, 115194, 55443, 54851, 255, 251, 13888, 1…
$ `10 to 14 years`     <dbl> 129091, 122352, 60427, 60065, 253, 245, 13255, 1…
$ `15 to 19 years`     <dbl> 119500, 116107, 52921, 55144, 281, 254, 11179, 9…
$ `20 to 24 years`     <dbl> 103665, 108513, 29948, 35165, 413, 331, 20237, 1…
$ `25 to 29 years`     <dbl> 86538, 88359, 19535, 23662, 239, 302, 12538, 107…
$ `30 to 34 years`     <dbl> 74452, 77595, 17196, 22021, 236, 284, 10331, 865…
$ `35 to 39 years`     <dbl> 71511, 74941, 16654, 22248, 161, 279, 9548, 7510…
$ `40 to 44 years`     <dbl> 75242, 78908, 17564, 24249, 127, 253, 8282, 6353…
$ `45 to 49 years`     <dbl> 73874, 78589, 18186, 23028, 108, 148, 6995, 5820…
$ `50 to 54 years`     <dbl> 68048, 72481, 17618, 22104, 95, 100, 5609, 4494,…
$ `55 to 59 years`     <dbl> 61071, 67699, 18118, 21909, 88, 93, 4029, 2986, …
$ `60 to 64 years`     <dbl> 52361, 61065, 16456, 20068, 69, 94, 2392, 1830, …
$ `65 to 69 years`     <dbl> 38977, 49685, 14498, 19364, 54, 73, 1292, 965, 2…
$ `70 to 74 years`     <dbl> 26767, 37227, 9541, 12509, 70, 66, 602, 496, 8, …
$ `75 to 79 years`     <dbl> 17504, 27163, 6030, 8291, 31, 52, 326, 305, 1, 5…
$ `80 to 84 years`     <dbl> 9937, 16470, 3485, 5031, 37, 30, 211, 186, 4, 5,…
$ `85 years and over`  <dbl> 5616, 10445, 2448, 4035, 76, 29, 143, 126, 19, 4…

dem_77_79 <- dem_77_79 %>%
  rename("race_sex" =`Race/Sex Indicator`) %>%
  mutate(SEX = str_extract(race_sex, "male|female"),
        RACE = str_extract(race_sex, "Black|White|Other"))%>%
  select(-`FIPS State Code`, -`race_sex`) %>%
  rename("YEAR" = `Year of Estimate`,
        "STATE" = `State Name`) %>%
  filter(YEAR %in% 1977:1979)

glimpse(dem_77_79)

Rows: 918
Columns: 22
$ YEAR                <dbl> 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1…
$ STATE               <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alab…
$ `Under 5 years`     <dbl> 98814, 94595, 46201, 45784, 590, 621, 14316, 1353…
$ `5 to 9 years`      <dbl> 113365, 107395, 50097, 49329, 672, 660, 14621, 13…
$ `10 to 14 years`    <dbl> 123107, 116182, 54925, 53955, 677, 653, 14795, 13…
$ `15 to 19 years`    <dbl> 135343, 130433, 58468, 59926, 674, 605, 15207, 13…
$ `20 to 24 years`    <dbl> 126053, 125352, 43898, 51433, 722, 773, 20106, 16…
$ `25 to 29 years`    <dbl> 111547, 112471, 31014, 36648, 638, 835, 20444, 18…
$ `30 to 34 years`    <dbl> 100674, 101543, 22528, 26694, 571, 766, 17514, 15…
$ `35 to 39 years`    <dbl> 81038, 83369, 17473, 22213, 498, 586, 13098, 1069…
$ `40 to 44 years`    <dbl> 75042, 77793, 16446, 22146, 356, 479, 10067, 7935…
$ `45 to 49 years`    <dbl> 76296, 79753, 16578, 22576, 295, 432, 8460, 6848,…
$ `50 to 54 years`    <dbl> 74844, 81079, 17117, 23028, 206, 326, 7268, 5914,…
$ `55 to 59 years`    <dbl> 67785, 75905, 16437, 21435, 166, 213, 5398, 4485,…
$ `60 to 64 years`    <dbl> 58853, 69406, 16276, 21075, 145, 174, 3349, 2708,…
$ `65 to 69 years`    <dbl> 48848, 62430, 15837, 21126, 107, 173, 1714, 1468,…
$ `70 to 74 years`    <dbl> 34475, 50075, 11450, 16028, 90, 138, 915, 928, 22…
$ `75 to 79 years`    <dbl> 20977, 34027, 7601, 10825, 53, 106, 500, 493, 10,…
$ `80 to 84 years`    <dbl> 10831, 21483, 3896, 6272, 25, 49, 237, 268, 4, 7,…
$ `85 years and over` <dbl> 6683, 15729, 2667, 5426, 33, 41, 153, 211, 11, 6,…
$ SEX                 <chr> "male", "female", "male", "female", "male", "fema…
$ RACE                <chr> "White", "White", "Black", "Black", "Other", "Oth…

That’s looking pretty good! We also want to take all the age group variabels and make one variable that is the age group name and one that is the value of the population count for that age group. To do this we will use the pivot_longer() function of the tidyr package. To use this function, we need to use the cols argument to indicate which columns we want to pivot. We also name the new variables we will create with the names_to and values_to arguments. The names_to will be the name of the variable that will identify each age group and values_to will be the name of the variable that contains the corresponding population values.

dem_77_79 <- dem_77_79 %>%
  pivot_longer(cols=contains("years"),
               names_to = "AGE_GROUP",
               values_to = "SUB_POP")

glimpse(dem_77_79)

Rows: 16,524
Columns: 6
$ YEAR      <dbl> 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977,…
$ STATE     <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alabama", "Ala…
$ SEX       <chr> "male", "male", "male", "male", "male", "male", "male", "ma…
$ RACE      <chr> "White", "White", "White", "White", "White", "White", "Whit…
$ AGE_GROUP <chr> "Under 5 years", "5 to 9 years", "10 to 14 years", "15 to 1…
$ SUB_POP   <dbl> 98814, 113365, 123107, 135343, 126053, 111547, 100674, 8103…

We also want to get data about the total population for the state for each year.

To do so we can sum all the values for the SUB_POP variable that we just created. To do this we can use the group_by and summarise() functions of the dplyr package. The group_by() function specifies how we want to calculate our sum, that we would like to calculate it for each year and each state individually. Thus, all the values that have the same STATE and YEAR values will be summed together, rather than summing using all of the values in the SUB_POP variable. The .groups argument allows us to remove the grouping after we peform the calculation with summarise().

pop_77_79 <- dem_77_79 %>%
  group_by(YEAR, STATE) %>%
  summarise("TOT_POP" = sum(SUB_POP), .groups = "drop") 

pop_77_79

# A tibble: 153 x 3
    YEAR STATE                 TOT_POP
   <dbl> <chr>                   <dbl>
 1  1977 Alabama               3782571
 2  1977 Alaska                 397220
 3  1977 Arizona               2427296
 4  1977 Arkansas              2207195
 5  1977 California           22350332
 6  1977 Colorado              2696179
 7  1977 Connecticut           3088745
 8  1977 Delaware               594815
 9  1977 District of Columbia   681766
10  1977 Florida               8888806
# … with 143 more rows

Now we will add the population value to the demographic tibble using the left_join() function of the dplyr package. It is imporant that we specify how this should be done, that the YEAR and STATE variable vlaues should match eachother. This will place the dem_77_79 variables to the left of the pop_77_79 data.

dem_77_79 <- dem_77_79 %>%
  left_join(pop_77_79, by = c("YEAR","STATE"))

dem_77_79

# A tibble: 16,524 x 7
    YEAR STATE   SEX   RACE  AGE_GROUP      SUB_POP TOT_POP
   <dbl> <chr>   <chr> <chr> <chr>            <dbl>   <dbl>
 1  1977 Alabama male  White Under 5 years    98814 3782571
 2  1977 Alabama male  White 5 to 9 years    113365 3782571
 3  1977 Alabama male  White 10 to 14 years  123107 3782571
 4  1977 Alabama male  White 15 to 19 years  135343 3782571
 5  1977 Alabama male  White 20 to 24 years  126053 3782571
 6  1977 Alabama male  White 25 to 29 years  111547 3782571
 7  1977 Alabama male  White 30 to 34 years  100674 3782571
 8  1977 Alabama male  White 35 to 39 years   81038 3782571
 9  1977 Alabama male  White 40 to 44 years   75042 3782571
10  1977 Alabama male  White 45 to 49 years   76296 3782571
# … with 16,514 more rows

We will also calculate the percentage that each group makes up of the total population, by dividing the SUB_POP by the TOT_POP and multiplying by 100 using the mutate() function. we will also remove the other population variables.

dem_77_79 %<>%
  mutate(PERC_SUB_POP = (SUB_POP/TOT_POP)*100) %>%
  select(-SUB_POP, -TOT_POP)

dem_77_79

# A tibble: 16,524 x 6
    YEAR STATE   SEX   RACE  AGE_GROUP      PERC_SUB_POP
   <dbl> <chr>   <chr> <chr> <chr>                 <dbl>
 1  1977 Alabama male  White Under 5 years          2.61
 2  1977 Alabama male  White 5 to 9 years           3.00
 3  1977 Alabama male  White 10 to 14 years         3.25
 4  1977 Alabama male  White 15 to 19 years         3.58
 5  1977 Alabama male  White 20 to 24 years         3.33
 6  1977 Alabama male  White 25 to 29 years         2.95
 7  1977 Alabama male  White 30 to 34 years         2.66
 8  1977 Alabama male  White 35 to 39 years         2.14
 9  1977 Alabama male  White 40 to 44 years         1.98
10  1977 Alabama male  White 45 to 49 years         2.02
# … with 16,514 more rows

It is important to make sure that we have the total values we would expect. We have two levels of SEX, three levels of Race, three levels of YEAR, eighteen levels of AGE_GROUP, and fifty one levels of STATE. If we multiply this together we get 16,524 which is the same as the number of rows in our final dem_77_79 data. Looks good!

Also Let’s make the values of the SEX variable capatalized so that they match the other values of the other variables like RACE etc. This will help us to keep consistent values across the different years as we wrangle the data for the other decades. To do so we will use the str_to_title() function of the stringr package. We need to use the pull() function to get the values of SEX out of dem_77_79. Once we make them captialized they are then reasigned to the SEX variable.

dem_77_79 %<>%
  mutate(SEX = str_to_title(pull(dem_77_79, SEX)))

# This can also be done line this:
dem_77_79 %<>%
  mutate(SEX = str_to_title(pull(., SEX)))

1980-1989

For this decade each year is a separate tibble and they are combined as a list.

class(dem_80_89)

[1] "list"

So the first thing we need to do is combine each tibble of the list together. We can do that using the bind_rows() function of dplyr which appends the data together based on the presence of columns with the same name in the different tibbles. We will use the map_df() function of the purrr package to allow us to do this across each tibble in our list.

dem_80_89 <- dem_80_89 %>%
  map_df(bind_rows)

glimpse(dem_80_89 )

Rows: 188,460
Columns: 21
$ `Year of Estimate`            <dbl> 1980, 1980, 1980, 1980, 1980, 1980, 198…
$ `FIPS State and County Codes` <chr> "01001", "01001", "01001", "01001", "01…
$ `Race/Sex Indicator`          <chr> "White male", "White female", "Black ma…
$ `Under 5 years`               <dbl> 985, 831, 357, 346, 4, 7, 2422, 2346, 6…
$ `5 to 9 years`                <dbl> 1096, 987, 427, 395, 9, 8, 2661, 2467, …
$ `10 to 14 years`              <dbl> 1271, 1074, 395, 415, 4, 11, 2783, 2614…
$ `15 to 19 years`              <dbl> 1308, 1259, 460, 429, 10, 5, 3049, 2841…
$ `20 to 24 years`              <dbl> 972, 1006, 300, 380, 3, 3, 2423, 2428, …
$ `25 to 29 years`              <dbl> 850, 912, 240, 235, 2, 11, 2372, 2475, …
$ `30 to 34 years`              <dbl> 891, 983, 163, 196, 4, 10, 2410, 2400, …
$ `35 to 39 years`              <dbl> 942, 1015, 120, 158, 3, 12, 2101, 2202,…
$ `40 to 44 years`              <dbl> 854, 882, 133, 147, 2, 11, 1881, 1859, …
$ `45 to 49 years`              <dbl> 828, 739, 107, 154, 4, 11, 1708, 1694, …
$ `50 to 54 years`              <dbl> 631, 602, 113, 165, 1, 7, 1657, 1798, 2…
$ `55 to 59 years`              <dbl> 524, 532, 113, 150, 1, 2, 1641, 1943, 1…
$ `60 to 64 years`              <dbl> 428, 451, 126, 166, 0, 1, 1630, 1819, 1…
$ `65 to 69 years`              <dbl> 358, 417, 128, 160, 1, 0, 1503, 1729, 1…
$ `70 to 74 years`              <dbl> 242, 332, 87, 119, 0, 0, 1163, 1335, 16…
$ `75 to 79 years`              <dbl> 123, 237, 70, 94, 0, 0, 671, 906, 87, 1…
$ `80 to 84 years`              <dbl> 52, 137, 31, 57, 0, 0, 331, 527, 43, 67…
$ `85 years and over`           <dbl> 39, 86, 13, 44, 0, 1, 187, 408, 27, 65,…

Great! Now our data is all together.

Now we will wrangle the data similarly to the previous decade.

dem_80_89 <- dem_80_89 %>%
  rename("race_sex" =`Race/Sex Indicator`) %>%
  mutate(SEX = str_extract(race_sex, "male|female"),
        RACE = str_extract(race_sex, "Black|White|Other"))%>%
  select( -`race_sex`) %>%
  rename("YEAR" = `Year of Estimate`)
         
glimpse(dem_80_89)

Rows: 188,460
Columns: 22
$ YEAR                          <dbl> 1980, 1980, 1980, 1980, 1980, 1980, 198…
$ `FIPS State and County Codes` <chr> "01001", "01001", "01001", "01001", "01…
$ `Under 5 years`               <dbl> 985, 831, 357, 346, 4, 7, 2422, 2346, 6…
$ `5 to 9 years`                <dbl> 1096, 987, 427, 395, 9, 8, 2661, 2467, …
$ `10 to 14 years`              <dbl> 1271, 1074, 395, 415, 4, 11, 2783, 2614…
$ `15 to 19 years`              <dbl> 1308, 1259, 460, 429, 10, 5, 3049, 2841…
$ `20 to 24 years`              <dbl> 972, 1006, 300, 380, 3, 3, 2423, 2428, …
$ `25 to 29 years`              <dbl> 850, 912, 240, 235, 2, 11, 2372, 2475, …
$ `30 to 34 years`              <dbl> 891, 983, 163, 196, 4, 10, 2410, 2400, …
$ `35 to 39 years`              <dbl> 942, 1015, 120, 158, 3, 12, 2101, 2202,…
$ `40 to 44 years`              <dbl> 854, 882, 133, 147, 2, 11, 1881, 1859, …
$ `45 to 49 years`              <dbl> 828, 739, 107, 154, 4, 11, 1708, 1694, …
$ `50 to 54 years`              <dbl> 631, 602, 113, 165, 1, 7, 1657, 1798, 2…
$ `55 to 59 years`              <dbl> 524, 532, 113, 150, 1, 2, 1641, 1943, 1…
$ `60 to 64 years`              <dbl> 428, 451, 126, 166, 0, 1, 1630, 1819, 1…
$ `65 to 69 years`              <dbl> 358, 417, 128, 160, 1, 0, 1503, 1729, 1…
$ `70 to 74 years`              <dbl> 242, 332, 87, 119, 0, 0, 1163, 1335, 16…
$ `75 to 79 years`              <dbl> 123, 237, 70, 94, 0, 0, 671, 906, 87, 1…
$ `80 to 84 years`              <dbl> 52, 137, 31, 57, 0, 0, 331, 527, 43, 67…
$ `85 years and over`           <dbl> 39, 86, 13, 44, 0, 1, 187, 408, 27, 65,…
$ SEX                           <chr> "male", "female", "male", "female", "ma…
$ RACE                          <chr> "White", "White", "Black", "Black", "Ot…

Notice that this time the state information is based on the numeric FIPS value. We want only the first two values, as the rest indicate the county. We can use the str_sub() function of the stringr package for this. We will specify that we want to start at the first position and end at the second. Just like str_extract() we need to rename this variable first so that it is compatible.

dem_80_89 %<>%
rename("STATEFP_temp" = "FIPS State and County Codes") %>%
mutate(STATEFP = str_sub(STATEFP_temp, start = 1, end = 2)) %>%
    left_join(STATE_FIPS, by = "STATEFP") %>%
  dplyr::select(-STATEFP)

glimpse(dem_80_89)

Rows: 188,460
Columns: 23
$ YEAR                <dbl> 1980, 1980, 1980, 1980, 1980, 1980, 1980, 1980, 1…
$ STATEFP_temp        <chr> "01001", "01001", "01001", "01001", "01001", "010…
$ `Under 5 years`     <dbl> 985, 831, 357, 346, 4, 7, 2422, 2346, 672, 645, 3…
$ `5 to 9 years`      <dbl> 1096, 987, 427, 395, 9, 8, 2661, 2467, 740, 680, …
$ `10 to 14 years`    <dbl> 1271, 1074, 395, 415, 4, 11, 2783, 2614, 644, 670…
$ `15 to 19 years`    <dbl> 1308, 1259, 460, 429, 10, 5, 3049, 2841, 711, 762…
$ `20 to 24 years`    <dbl> 972, 1006, 300, 380, 3, 3, 2423, 2428, 516, 601, …
$ `25 to 29 years`    <dbl> 850, 912, 240, 235, 2, 11, 2372, 2475, 414, 469, …
$ `30 to 34 years`    <dbl> 891, 983, 163, 196, 4, 10, 2410, 2400, 303, 352, …
$ `35 to 39 years`    <dbl> 942, 1015, 120, 158, 3, 12, 2101, 2202, 224, 260,…
$ `40 to 44 years`    <dbl> 854, 882, 133, 147, 2, 11, 1881, 1859, 206, 288, …
$ `45 to 49 years`    <dbl> 828, 739, 107, 154, 4, 11, 1708, 1694, 219, 236, …
$ `50 to 54 years`    <dbl> 631, 602, 113, 165, 1, 7, 1657, 1798, 203, 261, 7…
$ `55 to 59 years`    <dbl> 524, 532, 113, 150, 1, 2, 1641, 1943, 178, 219, 8…
$ `60 to 64 years`    <dbl> 428, 451, 126, 166, 0, 1, 1630, 1819, 171, 209, 8…
$ `65 to 69 years`    <dbl> 358, 417, 128, 160, 1, 0, 1503, 1729, 170, 232, 6…
$ `70 to 74 years`    <dbl> 242, 332, 87, 119, 0, 0, 1163, 1335, 164, 182, 4,…
$ `75 to 79 years`    <dbl> 123, 237, 70, 94, 0, 0, 671, 906, 87, 129, 3, 6, …
$ `80 to 84 years`    <dbl> 52, 137, 31, 57, 0, 0, 331, 527, 43, 67, 1, 2, 56…
$ `85 years and over` <dbl> 39, 86, 13, 44, 0, 1, 187, 408, 27, 65, 1, 1, 30,…
$ SEX                 <chr> "male", "female", "male", "female", "male", "fema…
$ RACE                <chr> "White", "White", "Black", "Black", "Other", "Oth…
$ STATE               <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alab…

dem_80_89 %<>%
  pivot_longer(cols=contains("years"),
               names_to = "AGE_GROUP",
               values_to = "SUB_POP_temp") %>%
  group_by(YEAR, STATE, AGE_GROUP, SEX, RACE) %>%
  summarise(SUB_POP = sum(SUB_POP_temp), .groups="drop")

dem_80_89

# A tibble: 55,080 x 6
    YEAR STATE   AGE_GROUP      SEX    RACE  SUB_POP
   <dbl> <chr>   <chr>          <chr>  <chr>   <dbl>
 1  1980 Alabama 10 to 14 years female Black   50108
 2  1980 Alabama 10 to 14 years female Other     805
 3  1980 Alabama 10 to 14 years female White  109066
 4  1980 Alabama 10 to 14 years male   Black   50768
 5  1980 Alabama 10 to 14 years male   Other     826
 6  1980 Alabama 10 to 14 years male   White  115988
 7  1980 Alabama 15 to 19 years female Black   58428
 8  1980 Alabama 15 to 19 years female Other     743
 9  1980 Alabama 15 to 19 years female White  126783
10  1980 Alabama 15 to 19 years male   Black   56808
# … with 55,070 more rows

pop_80_89 <- dem_80_89 %>%
  group_by(YEAR, STATE) %>%
  summarise("TOT_POP" = sum(SUB_POP), .groups = "drop") 


dem_80_89 <- dem_80_89 %>%
  left_join(pop_80_89, by = c("YEAR","STATE")) %>%
  mutate(PERC_SUB_POP = (SUB_POP/TOT_POP)*100) %>%
  dplyr::select(-SUB_POP, -TOT_POP)

dem_80_89

# A tibble: 55,080 x 6
    YEAR STATE   AGE_GROUP      SEX    RACE  PERC_SUB_POP
   <dbl> <chr>   <chr>          <chr>  <chr>        <dbl>
 1  1980 Alabama 10 to 14 years female Black       1.28  
 2  1980 Alabama 10 to 14 years female Other       0.0206
 3  1980 Alabama 10 to 14 years female White       2.80  
 4  1980 Alabama 10 to 14 years male   Black       1.30  
 5  1980 Alabama 10 to 14 years male   Other       0.0212
 6  1980 Alabama 10 to 14 years male   White       2.97  
 7  1980 Alabama 15 to 19 years female Black       1.50  
 8  1980 Alabama 15 to 19 years female Other       0.0191
 9  1980 Alabama 15 to 19 years female White       3.25  
10  1980 Alabama 15 to 19 years male   Black       1.46  
# … with 55,070 more rows

Just like with the data from the 70s we will also change the values for SEX to be capitalized.

dem_80_89 %<>%
  mutate(SEX = str_to_title(pull(., SEX)))

Again, it is important to make sure that we have the total values we would expect. This time we have: two levels of SEX, three levels of Race, ten levels of YEAR, eighteen levels of AGE_GROUP, and fifty one levels of STATE.

If we multiply these together we get 55,080, which is the same as the number of rows of the final dem_80_89 data. Looks good!

1990-1999

Just like the 80s we need to combine the data across the files:

dem_90_99 <- dem_90_99 %>%
  map_df(bind_rows)

glimpse(dem_90_99)

Rows: 43,870
Columns: 19
$ Year     <dbl> NA, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 19…
$ e        <chr> NA, "01", "01", "01", "01", "01", "01", "01", "01", "01", "0…
$ Age      <dbl> NA, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16…
$ Male     <dbl> NA, 20406, 19393, 18990, 19246, 19502, 19560, 19091, 19605, …
$ Female   <dbl> NA, 19101, 18114, 18043, 17786, 18366, 18386, 18047, 18316, …
$ Male_1   <dbl> NA, 9794, 9475, 9097, 9002, 9076, 9169, 8919, 9219, 9247, 10…
$ Female_1 <dbl> NA, 9414, 9247, 8837, 8701, 8989, 9093, 8736, 9192, 9108, 97…
$ Male_2   <dbl> NA, 103, 87, 97, 94, 108, 128, 160, 178, 166, 205, 194, 179,…
$ Female_2 <dbl> NA, 90, 93, 100, 115, 114, 130, 134, 162, 155, 193, 185, 202…
$ Male_3   <dbl> NA, 192, 146, 175, 150, 168, 170, 183, 171, 136, 177, 169, 1…
$ Female_3 <dbl> NA, 170, 182, 160, 157, 178, 158, 173, 177, 185, 179, 171, 1…
$ Male_4   <dbl> NA, 223, 190, 198, 186, 190, 210, 188, 178, 182, 221, 194, 1…
$ Female_4 <dbl> NA, 220, 196, 173, 191, 190, 170, 172, 179, 173, 166, 175, 1…
$ Male_5   <dbl> NA, 47, 41, 32, 35, 36, 30, 28, 27, 29, 32, 31, 33, 34, 32, …
$ Female_5 <dbl> NA, 45, 47, 41, 30, 26, 37, 23, 35, 31, 28, 38, 22, 39, 29, …
$ Male_6   <dbl> NA, 1, 2, 1, 9, 5, 8, 2, 4, 6, 6, 0, 1, 9, 6, 7, 5, 2, 2, 4,…
$ Female_6 <dbl> NA, 8, 0, 2, 1, 4, 5, 3, 4, 4, 3, 4, 2, 2, 7, 0, 2, 2, 1, 6,…
$ Male_7   <dbl> NA, 5, 7, 2, 3, 5, 11, 2, 7, 12, 10, 7, 5, 6, 5, 6, 6, 2, 11…
$ Female_7 <dbl> NA, 5, 5, 5, 3, 14, 6, 7, 6, 3, 11, 5, 5, 7, 8, 6, 6, 7, 3, …

For this decade the column names can’t all be imported in a simple way from the table, so they need to be recoded.

Here is what the data looks like before importing:

So, first using the base colnames() function we change the names of the column names.

colnames(dem_90_99) <- c("YEAR",
                         "STATEFP",
                         "Age",
                         "NH_W_M",
                         "NH_W_F",
                         "NH_B_M",
                         "NH_B_F",
                         "NH_AIAN_M",
                         "NH_AIAN_F",
                         "NH_API_M",
                         "NH_API_F",
                         "H_W_M",
                         "H_W_F",
                         "H_B_M",
                         "H_B_F",
                         "H_AIAN_M",
                         "H_AIAN_F",
                         "H_API_M",
                         "H_API_F")

glimpse(dem_90_99)

Rows: 43,870
Columns: 19
$ YEAR      <dbl> NA, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1…
$ STATEFP   <chr> NA, "01", "01", "01", "01", "01", "01", "01", "01", "01", "…
$ Age       <dbl> NA, 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 1…
$ NH_W_M    <dbl> NA, 20406, 19393, 18990, 19246, 19502, 19560, 19091, 19605,…
$ NH_W_F    <dbl> NA, 19101, 18114, 18043, 17786, 18366, 18386, 18047, 18316,…
$ NH_B_M    <dbl> NA, 9794, 9475, 9097, 9002, 9076, 9169, 8919, 9219, 9247, 1…
$ NH_B_F    <dbl> NA, 9414, 9247, 8837, 8701, 8989, 9093, 8736, 9192, 9108, 9…
$ NH_AIAN_M <dbl> NA, 103, 87, 97, 94, 108, 128, 160, 178, 166, 205, 194, 179…
$ NH_AIAN_F <dbl> NA, 90, 93, 100, 115, 114, 130, 134, 162, 155, 193, 185, 20…
$ NH_API_M  <dbl> NA, 192, 146, 175, 150, 168, 170, 183, 171, 136, 177, 169, …
$ NH_API_F  <dbl> NA, 170, 182, 160, 157, 178, 158, 173, 177, 185, 179, 171, …
$ H_W_M     <dbl> NA, 223, 190, 198, 186, 190, 210, 188, 178, 182, 221, 194, …
$ H_W_F     <dbl> NA, 220, 196, 173, 191, 190, 170, 172, 179, 173, 166, 175, …
$ H_B_M     <dbl> NA, 47, 41, 32, 35, 36, 30, 28, 27, 29, 32, 31, 33, 34, 32,…
$ H_B_F     <dbl> NA, 45, 47, 41, 30, 26, 37, 23, 35, 31, 28, 38, 22, 39, 29,…
$ H_AIAN_M  <dbl> NA, 1, 2, 1, 9, 5, 8, 2, 4, 6, 6, 0, 1, 9, 6, 7, 5, 2, 2, 4…
$ H_AIAN_F  <dbl> NA, 8, 0, 2, 1, 4, 5, 3, 4, 4, 3, 4, 2, 2, 7, 0, 2, 2, 1, 6…
$ H_API_M   <dbl> NA, 5, 7, 2, 3, 5, 11, 2, 7, 12, 10, 7, 5, 6, 5, 6, 6, 2, 1…
$ H_API_F   <dbl> NA, 5, 5, 5, 3, 14, 6, 7, 6, 3, 11, 5, 5, 7, 8, 6, 6, 7, 3,…

Notice also that the first row is all NA values from white space in the orginal table for 1990, this is probably true for each year. We can check them dimensions of our table using the base dim() function. When we filter for rows where YEAR is NA, we indeed see 10 rows, which is what we would expect if we have a row like this for each of the years in the decade. We see the same if we try a different variable. Now we will test to see how large our tibble is if we drop rows with NA values using the drop_na() function of tidyr. We that indeed our dimensions only changed by ten, so there are not other rows with missing values that we might not expect. So now we will resign the dem_90_99 variable after removing these rows.

dim(dem_90_99)

[1] 43870    19

dem_90_99 %>%
  filter(is.na(YEAR))

# A tibble: 10 x 19
    YEAR STATEFP   Age NH_W_M NH_W_F NH_B_M NH_B_F NH_AIAN_M NH_AIAN_F NH_API_M
   <dbl> <chr>   <dbl>  <dbl>  <dbl>  <dbl>  <dbl>     <dbl>     <dbl>    <dbl>
 1    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 2    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 3    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 4    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 5    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 6    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 7    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 8    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 9    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
10    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
# … with 9 more variables: NH_API_F <dbl>, H_W_M <dbl>, H_W_F <dbl>,
#   H_B_M <dbl>, H_B_F <dbl>, H_AIAN_M <dbl>, H_AIAN_F <dbl>, H_API_M <dbl>,
#   H_API_F <dbl>

dem_90_99 %>%
  filter(is.na(Age))

# A tibble: 10 x 19
    YEAR STATEFP   Age NH_W_M NH_W_F NH_B_M NH_B_F NH_AIAN_M NH_AIAN_F NH_API_M
   <dbl> <chr>   <dbl>  <dbl>  <dbl>  <dbl>  <dbl>     <dbl>     <dbl>    <dbl>
 1    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 2    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 3    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 4    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 5    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 6    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 7    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 8    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
 9    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
10    NA <NA>       NA     NA     NA     NA     NA        NA        NA       NA
# … with 9 more variables: NH_API_F <dbl>, H_W_M <dbl>, H_W_F <dbl>,
#   H_B_M <dbl>, H_B_F <dbl>, H_AIAN_M <dbl>, H_AIAN_F <dbl>, H_API_M <dbl>,
#   H_API_F <dbl>

dem_90_99 %>%drop_na()

# A tibble: 43,860 x 19
    YEAR STATEFP   Age NH_W_M NH_W_F NH_B_M NH_B_F NH_AIAN_M NH_AIAN_F NH_API_M
   <dbl> <chr>   <dbl>  <dbl>  <dbl>  <dbl>  <dbl>     <dbl>     <dbl>    <dbl>
 1  1990 01          0  20406  19101   9794   9414       103        90      192
 2  1990 01          1  19393  18114   9475   9247        87        93      146
 3  1990 01          2  18990  18043   9097   8837        97       100      175
 4  1990 01          3  19246  17786   9002   8701        94       115      150
 5  1990 01          4  19502  18366   9076   8989       108       114      168
 6  1990 01          5  19560  18386   9169   9093       128       130      170
 7  1990 01          6  19091  18047   8919   8736       160       134      183
 8  1990 01          7  19605  18316   9219   9192       178       162      171
 9  1990 01          8  18823  17743   9247   9108       166       155      136
10  1990 01          9  20226  19178  10194   9784       205       193      177
# … with 43,850 more rows, and 9 more variables: NH_API_F <dbl>, H_W_M <dbl>,
#   H_W_F <dbl>, H_B_M <dbl>, H_B_F <dbl>, H_AIAN_M <dbl>, H_AIAN_F <dbl>,
#   H_API_M <dbl>, H_API_F <dbl>

dem_90_99 %<>%drop_na()

Then we sum across the nonhispanic and hispaninc groups because this information is not available for the other previous decades. Then we will remove the variables for the hispanic and nonhispanic subgroups using select().

dem_90_99%<>%
    mutate(W_M = NH_W_M + H_W_M,
           W_F = NH_W_F + H_W_F,
           B_M = NH_B_M + H_B_M,
           B_F = NH_B_F + H_B_F,
           AIAN_M = NH_AIAN_M + H_AIAN_M,
           AIAN_F = NH_AIAN_F + H_AIAN_F,
           API_M = NH_API_M + H_API_M,
           API_F = NH_API_F + H_API_F) %>%
  select(-starts_with("NH_"), -starts_with("H_"))

glimpse(dem_90_99)

Rows: 43,860
Columns: 11
$ YEAR    <dbl> 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1…
$ STATEFP <chr> "01", "01", "01", "01", "01", "01", "01", "01", "01", "01", "…
$ Age     <dbl> 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17,…
$ W_M     <dbl> 20629, 19583, 19188, 19432, 19692, 19770, 19279, 19783, 19005…
$ W_F     <dbl> 19321, 18310, 18216, 17977, 18556, 18556, 18219, 18495, 17916…
$ B_M     <dbl> 9841, 9516, 9129, 9037, 9112, 9199, 8947, 9246, 9276, 10226, …
$ B_F     <dbl> 9459, 9294, 8878, 8731, 9015, 9130, 8759, 9227, 9139, 9812, 1…
$ AIAN_M  <dbl> 104, 89, 98, 103, 113, 136, 162, 182, 172, 211, 194, 180, 209…
$ AIAN_F  <dbl> 98, 93, 102, 116, 118, 135, 137, 166, 159, 196, 189, 204, 198…
$ API_M   <dbl> 197, 153, 177, 153, 173, 181, 185, 178, 148, 187, 176, 164, 1…
$ API_F   <dbl> 175, 187, 165, 160, 192, 164, 180, 183, 188, 190, 176, 168, 1…

Looking better! We also need to add age groups like the other decades. We will take a look at the 80s data using the distinct() function of the dplyr package to see what age groups we need. We can use the base cut() function to create a new variable with mutate() called AGE_GROUP that will have a label for every change in 5 years of age. The right = FALSE argument specifies that the interval is not closed on the right, meaning that if the value is at the cutpoint like the Age value is 5, then it will be in the 5 to 9 years group.

We can make the labels for the AGE_GROUP variable match those of dem_77_79 but we need to pull out the values of the tibble created by distinct(). To do this we can use the pull() function from the dplyr package. Note that it is important to check that the AGE_GROUP values are listed in order for dem_77_79. We will also remove the Age variable after we create the new AGE_GROUP variable for the dem_90_99 data.

distinct(dem_77_79, AGE_GROUP)

# A tibble: 18 x 1
   AGE_GROUP        
   <chr>            
 1 Under 5 years    
 2 5 to 9 years     
 3 10 to 14 years   
 4 15 to 19 years   
 5 20 to 24 years   
 6 25 to 29 years   
 7 30 to 34 years   
 8 35 to 39 years   
 9 40 to 44 years   
10 45 to 49 years   
11 50 to 54 years   
12 55 to 59 years   
13 60 to 64 years   
14 65 to 69 years   
15 70 to 74 years   
16 75 to 79 years   
17 80 to 84 years   
18 85 years and over

pull(distinct(dem_77_79, AGE_GROUP))

 [1] "Under 5 years"     "5 to 9 years"      "10 to 14 years"   
 [4] "15 to 19 years"    "20 to 24 years"    "25 to 29 years"   
 [7] "30 to 34 years"    "35 to 39 years"    "40 to 44 years"   
[10] "45 to 49 years"    "50 to 54 years"    "55 to 59 years"   
[13] "60 to 64 years"    "65 to 69 years"    "70 to 74 years"   
[16] "75 to 79 years"    "80 to 84 years"    "85 years and over"

dem_90_99 %<>%
  mutate(AGE_GROUP = cut(Age,
                         breaks = seq(0,90, by=5),
                         right = FALSE, labels = pull(distinct(dem_77_79,AGE_GROUP), AGE_GROUP))) %>%
  select(-Age)

glimpse(dem_90_99)

Rows: 43,860
Columns: 11
$ YEAR      <dbl> 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990, 1990,…
$ STATEFP   <chr> "01", "01", "01", "01", "01", "01", "01", "01", "01", "01",…
$ W_M       <dbl> 20629, 19583, 19188, 19432, 19692, 19770, 19279, 19783, 190…
$ W_F       <dbl> 19321, 18310, 18216, 17977, 18556, 18556, 18219, 18495, 179…
$ B_M       <dbl> 9841, 9516, 9129, 9037, 9112, 9199, 8947, 9246, 9276, 10226…
$ B_F       <dbl> 9459, 9294, 8878, 8731, 9015, 9130, 8759, 9227, 9139, 9812,…
$ AIAN_M    <dbl> 104, 89, 98, 103, 113, 136, 162, 182, 172, 211, 194, 180, 2…
$ AIAN_F    <dbl> 98, 93, 102, 116, 118, 135, 137, 166, 159, 196, 189, 204, 1…
$ API_M     <dbl> 197, 153, 177, 153, 173, 181, 185, 178, 148, 187, 176, 164,…
$ API_F     <dbl> 175, 187, 165, 160, 192, 164, 180, 183, 188, 190, 176, 168,…
$ AGE_GROUP <fct> Under 5 years, Under 5 years, Under 5 years, Under 5 years,…

Like the previous decades we will create a RACE and SUB_POP variable using pivot_longer() to create a single Race variable out of all the subgroup variables.

Now we need to collapse the data for the various races so that it matches the previous decades. This time we will use the case_when() function of the dplyr package and the str_detect() function of the stringr package to identify when the race is something other than B or W and replace with the value Other. The value to the right of the ~ indicates what we want the value of the new variable to be if the value of the variable we are using with str_decect() matches the condition specified. If the value does not match the specified condition, than the other values will be what ever is listed after TRUE ~. We will then create population counts as we did previously for the other decades.

Finally, we will create new sums for the subpopulations where we sum across the two Other subgroups Race to a create a single value for each value of YEAR, SEX, AGE_GROUP, and STATE by using the group_by() function and summarie().

dem_90_99  %<>%
  pivot_longer(cols = c(starts_with("W_"),
                    starts_with("B_"),
                    starts_with("AIAN_"),
                    starts_with("API_")),
               names_to = "RACE",
               values_to = "SUB_POP_temp")

dem_90_99 %<>%
  mutate(SEX = case_when(str_detect(RACE, "_M") ~ "Male",
                         TRUE ~ "Female"),
         RACE = case_when(str_detect(RACE, "W_") ~ "White",
                          str_detect(RACE, "B_") ~ "Black",
                          TRUE ~ "Other")) %>%
  left_join(STATE_FIPS, by = "STATEFP") %>%
  dplyr::select(-STATEFP)

dem_90_99 %<>%
  group_by(YEAR, STATE, AGE_GROUP, SEX, RACE) %>%
  summarise(SUB_POP = sum(SUB_POP_temp), .groups="drop")

pop_90_99 <- dem_90_99 %>%
  group_by(YEAR, STATE) %>%
  summarise(TOT_POP = sum(SUB_POP), .groups = "drop")

dem_90_99 <- dem_90_99 %>%
  left_join(pop_90_99, by=c("YEAR", "STATE")) %>%
  mutate(PERC_SUB_POP = (SUB_POP/TOT_POP)*100) %>%
  dplyr::select(-SUB_POP, -TOT_POP)

dem_90_99

# A tibble: 55,080 x 6
    YEAR STATE   AGE_GROUP     SEX    RACE  PERC_SUB_POP
   <dbl> <chr>   <fct>         <chr>  <chr>        <dbl>
 1  1990 Alabama Under 5 years Female Black       1.12  
 2  1990 Alabama Under 5 years Female Other       0.0347
 3  1990 Alabama Under 5 years Female White       2.28  
 4  1990 Alabama Under 5 years Male   Black       1.15  
 5  1990 Alabama Under 5 years Male   Other       0.0336
 6  1990 Alabama Under 5 years Male   White       2.43  
 7  1990 Alabama 5 to 9 years  Female Black       1.14  
 8  1990 Alabama 5 to 9 years  Female Other       0.0419
 9  1990 Alabama 5 to 9 years  Female White       2.29  
10  1990 Alabama 5 to 9 years  Male   Black       1.16  
# … with 55,070 more rows

Again, we should check to make sure that we have the total values we would expect. We have the same number of unique values for each of our variables as in with the data from the 80s, so if we collpased the data for the different additional subpopulations in this data, then we have done it correctly.

Indeed it looks like we have 55,080 rows, which is what we would expect and is the same as the number of rows of the final dem_80_89 data. Looks good!

2000-2010

Again, for this decade we need to combine the data across years.

dem_00_10 <- dem_00_10 %>%
  map_df(bind_rows)

glimpse(dem_00_10)

Rows: 62,244
Columns: 21
$ REGION            <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ DIVISION          <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ STATE             <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ NAME              <chr> "United States", "United States", "United States", …
$ SEX               <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ ORIGIN            <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ RACE              <dbl> 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, …
$ AGEGRP            <dbl> 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 1…
$ ESTIMATESBASE2000 <dbl> 281424600, 19176154, 20549855, 20528425, 20218782, …
$ POPESTIMATE2000   <dbl> 282162411, 19178293, 20463852, 20637696, 20294955, …
$ POPESTIMATE2001   <dbl> 284968955, 19298217, 20173362, 20978678, 20456284, …
$ POPESTIMATE2002   <dbl> 287625193, 19429192, 19872417, 21261421, 20610370, …
$ POPESTIMATE2003   <dbl> 290107933, 19592446, 19620851, 21415353, 20797166, …
$ POPESTIMATE2004   <dbl> 292805298, 19785885, 19454237, 21411680, 21102552, …
$ POPESTIMATE2005   <dbl> 295516599, 19917400, 19389067, 21212579, 21486214, …
$ POPESTIMATE2006   <dbl> 298379912, 19938883, 19544688, 21033138, 21807709, …
$ POPESTIMATE2007   <dbl> 301231207, 20125962, 19714611, 20841042, 22067816, …
$ POPESTIMATE2008   <dbl> 304093966, 20271127, 19929602, 20706655, 22210880, …
$ POPESTIMATE2009   <dbl> 306771529, 20244518, 20182499, 20660564, 22192810, …
$ CENSUS2010POP     <dbl> 308745538, 20201362, 20348657, 20677194, 22040343, …
$ POPESTIMATE2010   <dbl> 309349689, 20200529, 20382409, 20694011, 21959087, …

Ok, the data looks a bit different from the others. First we will remove a couple of variables that we probably don’t need. Also it looks like we have some values for the entire United Sates and we will drop these to be like the other decades.

dem_00_10 %<>%
  select(-ESTIMATESBASE2000,-CENSUS2010POP) %>%
  filter(NAME != "United States")

We can see that there are lots of values that are zero. According to the technical documentation for this data, zero values indicate the total for the other categories of Sex, Origin, Race, and AGEGRP.

So we will drop the total values for SEX, RACE, and AGEGRP by removing the rows where these variables are equal to zero.

We will also want to only select for the total values for Origin as we do not wish to divide the data into subgroups about hispanic ethnicity because we do not have that information for the first two decades. Thus we will filter for only the rows where Origin is equal to zero.

We will also then remove the REGION, Division, STATE, and Origin variables. We will then rename NAME to be STATE and rename AGEGRP to be like the other decades as AGE_GROUP.

dem_00_10 %<>%
  filter(SEX != 0,
         RACE != 0,
         AGEGRP != 0, 
         ORIGIN == 0) %>%
  dplyr::select(-REGION, -DIVISION, -ORIGIN, -STATE) %>%
  rename("STATE" = NAME,
         "AGE_GROUP" = AGEGRP)

dem_00_10

# A tibble: 11,016 x 15
   STATE   SEX  RACE AGE_GROUP POPESTIMATE2000 POPESTIMATE2001 POPESTIMATE2002
   <chr> <dbl> <dbl>     <dbl>           <dbl>           <dbl>           <dbl>
 1 Alab…     1     1         1           99527           99985           99578
 2 Alab…     1     1         2          104423          102518          101023
 3 Alab…     1     1         3          108325          108412          108059
 4 Alab…     1     1         4          108638          107370          107337
 5 Alab…     1     1         5          104337          107230          108195
 6 Alab…     1     1         6          106491          101466           98949
 7 Alab…     1     1         7          110116          110630          110416
 8 Alab…     1     1         8          123719          120283          116502
 9 Alab…     1     1         9          124961          125443          124751
10 Alab…     1     1        10          115024          117010          119354
# … with 11,006 more rows, and 8 more variables: POPESTIMATE2003 <dbl>,
#   POPESTIMATE2004 <dbl>, POPESTIMATE2005 <dbl>, POPESTIMATE2006 <dbl>,
#   POPESTIMATE2007 <dbl>, POPESTIMATE2008 <dbl>, POPESTIMATE2009 <dbl>,
#   POPESTIMATE2010 <dbl>

Now we need to recode the numeric values to the values in the techincal documentation. We can do so by adding labels to each numeric level using the base function factor().

dem_00_10 %<>%
  mutate(SEX = factor(SEX,
                            levels = 1:2,
                            labels = c("Male",
                                    "Female")),
         RACE = factor(RACE,
                            levels = 1:6,
                            labels = c("White",
                                    "Black",
                                    rep("Other",4))),
         AGE_GROUP = factor(AGE_GROUP,
                            levels = 1:18,
                            labels = pull(distinct(dem_77_79,AGE_GROUP), AGE_GROUP)))
                            
glimpse(dem_00_10)

Rows: 11,016
Columns: 15
$ STATE           <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alabama"…
$ SEX             <fct> Male, Male, Male, Male, Male, Male, Male, Male, Male,…
$ RACE            <fct> White, White, White, White, White, White, White, Whit…
$ AGE_GROUP       <fct> Under 5 years, 5 to 9 years, 10 to 14 years, 15 to 19…
$ POPESTIMATE2000 <dbl> 99527, 104423, 108325, 108638, 104337, 106491, 110116…
$ POPESTIMATE2001 <dbl> 99985, 102518, 108412, 107370, 107230, 101466, 110630…
$ POPESTIMATE2002 <dbl> 99578, 101023, 108059, 107337, 108195, 98949, 110416,…
$ POPESTIMATE2003 <dbl> 99627, 99920, 108026, 107749, 109360, 98276, 109893, …
$ POPESTIMATE2004 <dbl> 99788, 99306, 107627, 108666, 109037, 98742, 107653, …
$ POPESTIMATE2005 <dbl> 100316, 99754, 106570, 110278, 108727, 100327, 105151…
$ POPESTIMATE2006 <dbl> 100820, 101251, 106228, 111640, 108847, 103869, 10161…
$ POPESTIMATE2007 <dbl> 101766, 101985, 106243, 112353, 109496, 105175, 99917…
$ POPESTIMATE2008 <dbl> 102304, 102479, 106155, 113305, 110007, 106348, 99921…
$ POPESTIMATE2009 <dbl> 101411, 102688, 106130, 113741, 111167, 106497, 10138…
$ POPESTIMATE2010 <dbl> 99480, 102939, 106324, 112272, 112423, 106593, 102923…

OK, we also want to change the shape of the data so that we have a YEAR variable and each estimate of the population is a value in a new variable called SUB_POP_temp.

dem_00_10 %<>%
  pivot_longer(cols=contains("ESTIMATE"),
               names_to = "YEAR",
               values_to = "SUB_POP_temp")

We will now clean up the YEAR variable to only be the numeric value by keeping only the last 4 values of each string using the str_sub() function of the stringr package.

dem_00_10 %<>%
  mutate(YEAR = str_sub(YEAR, start=-4)) %>%
  mutate(YEAR = as.numeric(YEAR))

Now we will collapse the data for the different RACES and calculate a new SUB_POP value.

dem_00_10 %<>%
  group_by(YEAR, AGE_GROUP, STATE, SEX, RACE) %>%
  summarise(SUB_POP = sum(SUB_POP_temp), .groups = "drop")

Agian, the dimensions look as we expect with 60,588 rows. This time we have two levels of SEX, three levels of Race, 11 levels of YEAR, eighteen levels of AGE_GROUP, and fifty one levels of STATE. If we multiply this together we get 16,588. Looks good!

Now we will calculate the total polutation and percent of the total as we have done with the previous decades.

pop_00_10 <- dem_00_10 %>%
  group_by(YEAR, STATE) %>%
  summarise(TOT_POP = sum(SUB_POP), .groups = "drop")

We can also check that our wrangling was performecd correctly by summing the values for the individual subpopulations percentages and seeing if it totals to 100.

dem_00_10 %>%
  left_join(pop_00_10, by=c("YEAR", "STATE")) %>%
  group_by(YEAR, STATE) %>%
  mutate(PERC_SUB_POP = (SUB_POP/TOT_POP)*100) %>%
  summarise(perc_tot = sum(PERC_SUB_POP), .groups = "drop") %>%
  mutate(poss_error = case_when(abs(perc_tot - 100) > 0 ~ TRUE,
                                TRUE ~ FALSE)) %>%
  group_by(poss_error) %>%
  tally()

# A tibble: 1 x 2
  poss_error     n
  <lgl>      <int>
1 FALSE        561

Looks like the percentages for each state for each year all add up to 100, as we would expect. Great! Now we will reasign the dem_00_10 data with this processing.

dem_00_10 %<>%
  left_join(pop_00_10, by = c("YEAR", "STATE")) %>%
  mutate(PERC_SUB_POP = (SUB_POP/TOT_POP)*100) %>%
 select(-SUB_POP, -TOT_POP)

dem_00_10

# A tibble: 60,588 x 6
    YEAR AGE_GROUP     STATE   SEX    RACE  PERC_SUB_POP
   <dbl> <fct>         <chr>   <fct>  <fct>        <dbl>
 1  2000 Under 5 years Alabama Male   White       2.24  
 2  2000 Under 5 years Alabama Male   Black       1.05  
 3  2000 Under 5 years Alabama Male   Other       0.101 
 4  2000 Under 5 years Alabama Female White       2.12  
 5  2000 Under 5 years Alabama Female Black       1.03  
 6  2000 Under 5 years Alabama Female Other       0.0995
 7  2000 Under 5 years Alaska  Male   White       2.35  
 8  2000 Under 5 years Alaska  Male   Black       0.165 
 9  2000 Under 5 years Alaska  Male   Other       1.37  
10  2000 Under 5 years Alaska  Female White       2.26  
# … with 60,578 more rows

OK, now we are ready to combine all of our demgraphic data together!

Combining demographic data

We can check that the colnames are the same for the data for each of the decades by using the setequal() function of the dplyr package.

setequal(colnames(dem_77_79),colnames(dem_80_89))

[1] TRUE

setequal(colnames(dem_80_89),colnames(dem_90_99))

[1] TRUE

setequal(colnames(dem_90_99),colnames(dem_00_10))

[1] TRUE

We can also confirm that we have the same number of age groups for each decade by using the base length() function. If you did not take a look at the wrangling for the demographic data then you may be unfamiliar with the pull() function of the dplyr package. This allows you to grab the values of a variable from a tibble. The distinct() function which is also of the dplyr package creates a tibble of the unique values for a variable.

length(pull(distinct(dem_77_79, AGE_GROUP), AGE_GROUP))

[1] 18

length(pull(distinct(dem_80_89, AGE_GROUP), AGE_GROUP))

[1] 18

length(pull(distinct(dem_90_99, AGE_GROUP), AGE_GROUP))

[1] 18

length(pull(distinct(dem_00_10, AGE_GROUP), AGE_GROUP))

[1] 18

Looks good!

Now we will combine the data using the bind_rows() function of the dplyr package. This function appends the data together based on the presence of columns with the same name in the different tibbles.

dem <- bind_rows(dem_77_79,
                 dem_80_89,
                 dem_90_99,
                 dem_00_10)

glimpse(dem)

Rows: 187,272
Columns: 6
$ YEAR         <dbl> 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977, 19…
$ STATE        <chr> "Alabama", "Alabama", "Alabama", "Alabama", "Alabama", "…
$ SEX          <chr> "Male", "Male", "Male", "Male", "Male", "Male", "Male", …
$ RACE         <chr> "White", "White", "White", "White", "White", "White", "W…
$ AGE_GROUP    <chr> "Under 5 years", "5 to 9 years", "10 to 14 years", "15 t…
$ PERC_SUB_POP <dbl> 2.6123502, 2.9970356, 3.2545853, 3.5780690, 3.3324688, 2…

Great! now we have a really large single tibble.

Now we want to select similar demographic data to what was used in the previous analyses.

Here is the table from the Donohue paper that compares the data used in the analyses.

We can see that only the percentage of males that were from age 15-39 of the race groups (black, white, and other) were used in the Donohue analysis.

Ultimately we intend to make a tibble of data that is similar to each analysis. Therefore, we will create a data tibble about the demogrphaic data for each analysis now.

To do so we will first create a vector of the age groups that should be included in the Donohue-like analysis, that we will call DONOHUE_AGE_GROUPS. We will then filter for only the age groups in this vector by using the filter() function of the dplyr package and the %in% operator to indicate that we want to keep all AGE_GROUP values that are equal to those within DONOHUE_AGE_GROUPS. We also want to filter for only population percentages for males by using the == operator. Then we can collpase the age groups from 20-39 by using the fct_collpase() function of the forcats package.

DONOHUE_AGE_GROUPS <- c("15 to 19 years",
                        "20 to 24 years",
                        "25 to 29 years",
                        "30 to 34 years",
                        "35 to 39 years")

dem_DONOHUE <- dem %>%
  filter(AGE_GROUP %in% DONOHUE_AGE_GROUPS,
               SEX == "Male") %>%
  mutate(AGE_GROUP = fct_collapse(AGE_GROUP, "20 to 39 years"=c("20 to 24 years",
                                                                "25 to 29 years",
                                                                "30 to 34 years",
                                                                "35 to 39 years")))

dem_DONOHUE

# A tibble: 26,010 x 6
    YEAR STATE   SEX   RACE  AGE_GROUP      PERC_SUB_POP
   <dbl> <chr>   <chr> <chr> <fct>                 <dbl>
 1  1977 Alabama Male  White 15 to 19 years        3.58 
 2  1977 Alabama Male  White 20 to 39 years        3.33 
 3  1977 Alabama Male  White 20 to 39 years        2.95 
 4  1977 Alabama Male  White 20 to 39 years        2.66 
 5  1977 Alabama Male  White 20 to 39 years        2.14 
 6  1977 Alabama Male  Black 15 to 19 years        1.55 
 7  1977 Alabama Male  Black 20 to 39 years        1.16 
 8  1977 Alabama Male  Black 20 to 39 years        0.820
 9  1977 Alabama Male  Black 20 to 39 years        0.596
10  1977 Alabama Male  Black 20 to 39 years        0.462
# … with 26,000 more rows

We also want to create a new variable that will contain all the demographic information for each percentage just as was done in the Donohue, et al. analysis. This should result in 6 different demographic variables.

To do this we will modify the AGE_GROUP variable by using the mutate() function of the dplyr package. We will replace the spaces in the now two age group categorise with and undesrscore using the str_replace_all() function of the stringr package which replaces all instances of a pattern in a character string.

Then we will use the group_by() function and the summarise() funtion also of the dplyr package to allow us to calculate a sum of the percentages for each of the subpopulation percentages for the newly modifed age groups in AGE_GROUP. The .groups = "drop" argument allows for the grouping to be removed after the summarise() function.

dem_DONOHUE %<>%
  mutate(AGE_GROUP = str_replace_all(string = AGE_GROUP, 
                                     pattern = " ", 
                                     replacement = "_")) %>%
  group_by(YEAR, STATE, RACE, SEX, AGE_GROUP) %>%
  summarise(PERC_SUB_POP = sum(PERC_SUB_POP), .groups = "drop")

dem_DONOHUE

# A tibble: 10,404 x 6
    YEAR STATE   RACE  SEX   AGE_GROUP      PERC_SUB_POP
   <dbl> <chr>   <chr> <chr> <chr>                 <dbl>
 1  1977 Alabama Black Male  15_to_19_years       1.55  
 2  1977 Alabama Black Male  20_to_39_years       3.04  
 3  1977 Alabama Other Male  15_to_19_years       0.0178
 4  1977 Alabama Other Male  20_to_39_years       0.0642
 5  1977 Alabama White Male  15_to_19_years       3.58  
 6  1977 Alabama White Male  20_to_39_years      11.1   
 7  1977 Alaska  Black Male  15_to_19_years       0.163 
 8  1977 Alaska  Black Male  20_to_39_years       0.968 
 9  1977 Alaska  Other Male  15_to_19_years       1.12  
10  1977 Alaska  Other Male  20_to_39_years       2.73  
# … with 10,394 more rows

Now we will combine the variables RACE, SEX, and AGE_GROUP together into one string separated by underscores using the unite function of the tidyr package. we will call this new variable VARIABLE. We will rename the PERC_SUB_POP variable to be VALUE using the rename() function of the dplyr package. The new name should be listed first before the =.

dem_DONOHUE %<>%
  unite(col = "VARIABLE", RACE, SEX, AGE_GROUP, sep = "_") %>%
  rename("VALUE" = PERC_SUB_POP)

dem_DONOHUE

# A tibble: 10,404 x 4
    YEAR STATE   VARIABLE                    VALUE
   <dbl> <chr>   <chr>                       <dbl>
 1  1977 Alabama Black_Male_15_to_19_years  1.55  
 2  1977 Alabama Black_Male_20_to_39_years  3.04  
 3  1977 Alabama Other_Male_15_to_19_years  0.0178
 4  1977 Alabama Other_Male_20_to_39_years  0.0642
 5  1977 Alabama White_Male_15_to_19_years  3.58  
 6  1977 Alabama White_Male_20_to_39_years 11.1   
 7  1977 Alaska  Black_Male_15_to_19_years  0.163 
 8  1977 Alaska  Black_Male_20_to_39_years  0.968 
 9  1977 Alaska  Other_Male_15_to_19_years  1.12  
10  1977 Alaska  Other_Male_20_to_39_years  2.73  
# … with 10,394 more rows

Let’s do a quick row number check. We have six different demographic variables, 51 states (DC counts as a state in this case), and 34 different years from 1977 to 2010, we should have 10,404 rows, which we do!

Now, let’s do the same for the “Lott-like” analysis.

So, in this analysis there were 36 variables covering percentages of indiviuals from 10 to over 65, three race groups and both males and females. This table is misprinted and does not include the word “Other” for the third race group that was used.

First we will filter out the age groups that were not included. Then we will collapse the age groups to those that were used by Lott et al. again using the fct_collpase() function of the forcats package.

Also we will again combine the values across the variables to create a new demographic varaible with 36 levels.

LOTT_AGE_GROUPS_NULL <- c("Under 5 years",
                          "5 to 9 years")

dem_LOTT <- dem %>%
  filter(!(AGE_GROUP %in% LOTT_AGE_GROUPS_NULL) )%>%
  mutate(AGE_GROUP = fct_collapse(AGE_GROUP,
                                  "10 to 19 years"=c("10 to 14 years",
                                                     "15 to 19 years"),
                                  "20 to 29 years"=c("20 to 24 years",
                                                     "25 to 29 years"),
                                  "30 to 39 years"=c("30 to 34 years",
                                                     "35 to 39 years"),
                                  "40 to 49 years"=c("40 to 44 years",
                                                     "45 to 49 years"),
                                  "50 to 64 years"=c("50 to 54 years",
                                                     "55 to 59 years",
                                                     "60 to 64 years"),
                                  "65 years and over"=c("65 to 69 years",
                                                        "70 to 74 years",
                                                        "75 to 79 years",
                                                        "80 to 84 years",
                                                        "85 years and over"))) %>%
  mutate(AGE_GROUP = str_replace_all(AGE_GROUP," ","_")) %>%
  group_by(YEAR, STATE, RACE, SEX, AGE_GROUP) %>%
  summarise(PERC_SUB_POP = sum(PERC_SUB_POP), .groups = "drop") %>%
  unite(col = "VARIABLE", RACE, SEX, AGE_GROUP, sep = "_") %>%
  rename("VALUE"=PERC_SUB_POP)

We can indeed check that we have the correct number of levels for VARIABLE using the distinct() function.

 distinct(dem_LOTT, VARIABLE)

# A tibble: 36 x 1
   VARIABLE                      
   <chr>                         
 1 Black_Female_10_to_19_years   
 2 Black_Female_20_to_29_years   
 3 Black_Female_30_to_39_years   
 4 Black_Female_40_to_49_years   
 5 Black_Female_50_to_64_years   
 6 Black_Female_65_years_and_over
 7 Black_Male_10_to_19_years     
 8 Black_Male_20_to_29_years     
 9 Black_Male_30_to_39_years     
10 Black_Male_40_to_49_years     
# … with 26 more rows

Combining population Data

We also have population data for each decade that came from wrangling the demogrphic data.

We again want to combine this data, so let’s again make sure that all the different tibbles have the same column names.

setequal(colnames(pop_77_79),colnames(pop_80_89))

[1] TRUE

setequal(colnames(pop_80_89),colnames(pop_90_99))

[1] TRUE

setequal(colnames(pop_90_99),colnames(pop_00_10))

[1] TRUE

head(pop_77_79)

# A tibble: 6 x 3
   YEAR STATE       TOT_POP
  <dbl> <chr>         <dbl>
1  1977 Alabama     3782571
2  1977 Alaska       397220
3  1977 Arizona     2427296
4  1977 Arkansas    2207195
5  1977 California 22350332
6  1977 Colorado    2696179

head(pop_80_89)

# A tibble: 6 x 3
   YEAR STATE       TOT_POP
  <dbl> <chr>         <dbl>
1  1980 Alabama     3899671
2  1980 Alaska       404680
3  1980 Arizona     2735840
4  1980 Arkansas    2288809
5  1980 California 23792840
6  1980 Colorado    2909545

head(pop_90_99)

# A tibble: 6 x 3
   YEAR STATE       TOT_POP
  <dbl> <chr>         <dbl>
1  1990 Alabama     4048508
2  1990 Alaska       553120
3  1990 Arizona     3679056
4  1990 Arkansas    2354343
5  1990 California 29950111
6  1990 Colorado    3303862

head(pop_00_10)

# A tibble: 6 x 3
   YEAR STATE       TOT_POP
  <dbl> <chr>         <dbl>
1  2000 Alabama     4452173
2  2000 Alaska       627963
3  2000 Arizona     5160586
4  2000 Arkansas    2678588
5  2000 California 33987977
6  2000 Colorado    4326921

Looks good!

population_data <- bind_rows(pop_77_79,
                             pop_80_89,
                             pop_90_99,
                             pop_00_10)

population_data <- population_data %>%
  mutate(VARIABLE = "Population") %>%
  rename("VALUE" = TOT_POP)

We could check that we have 51 values for each year by using the count() function of the dplyr package.

population_data %>%
  count(YEAR)

# A tibble: 34 x 2
    YEAR     n
   <dbl> <int>
 1  1977    51
 2  1978    51
 3  1979    51
 4  1980    51
 5  1981    51
 6  1982    51
 7  1983    51
 8  1984    51
 9  1985    51
10  1986    51
# … with 24 more rows

Police staffing

Click here to see details about how the plice staffing data was wrangled.

OK, now we will wrangle the police staffing data. We want to limit the data to only the years of interest. Then we will also replace NA values with zero for the male_total_ct and female_total_ct variables using the replace_na() function of the tidyr packge. We will also, use the across() function of the dplyr package to select and mutate both of these columns in this way. Since both of these variables have total_ct in the name and no other variables do, we can use the contains() function of the dplyr package to specify that we want to use these columns instead of listing both out.

avocado… why not 2010….

glimpse(ps_data)

Rows: 1,439,467
Columns: 21
$ data_year             <dbl> 1960, 1960, 1960, 1960, 1960, 1960, 1960, 1960,…
$ ori                   <chr> "AK020045Y", "AL0011000", "AL0160600", "AL01900…
$ pub_agency_name       <chr> "Alcohol Beverage Control Board", "Homewood", "…
$ pub_agency_unit       <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ state_abbr            <chr> "AK", "AL", "AL", "AL", "AL", "AL", "AL", "AL",…
$ division_name         <chr> "Pacific", "East South Central", "East South Ce…
$ region_name           <chr> "West", "South", "South", "South", "South", "So…
$ county_name           <chr> "N/A", "JEFFERSON", "N/A", "COFFEE", "N/A", "HA…
$ agency_type_name      <chr> "Other State Agency", "City", "City", "County",…
$ population_group_desc <chr> "Cities under 2,500", "Cities from 10,000 thru …
$ population            <dbl> 0, 20289, 0, 14852, 0, 3081, 0, 18739, 2776, 0,…
$ male_officer_ct       <dbl> NA, 17, NA, 0, NA, 0, NA, 0, 0, NA, NA, 0, NA, …
$ male_civilian_ct      <dbl> NA, 3, NA, 0, NA, 0, NA, 0, 0, NA, NA, 0, NA, N…
$ male_total_ct         <dbl> NA, 20, NA, 0, NA, 0, NA, 0, 0, NA, NA, 0, NA, …
$ female_officer_ct     <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ female_civilian_ct    <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ female_total_ct       <dbl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ officer_ct            <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ civilian_ct           <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ total_pe_ct           <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ pe_ct_per_1000        <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…

ps_data %<>%
  filter(data_year >= 1977, 
         data_year <= 2014) %>%
mutate(across(.cols =contains("total_ct"), ~replace_na(., 0)))

glimpse(ps_data)

Rows: 932,063
Columns: 21
$ data_year             <dbl> 1977, 1977, 1977, 1977, 1977, 1977, 1977, 1977,…
$ ori                   <chr> "AK0012000", "AK0012300", "AKASP0000", "AL00125…
$ pub_agency_name       <chr> "Soldotna", "Kenai", "Alaska State Troopers", "…
$ pub_agency_unit       <chr> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ state_abbr            <chr> "AK", "AK", "AK", "AL", "AL", "AL", "AL", "AL",…
$ division_name         <chr> "Pacific", "Pacific", "Pacific", "East South Ce…
$ region_name           <chr> "West", "West", "West", "South", "South", "Sout…
$ county_name           <chr> "KENAI PENINSULA", "KENAI PENINSULA", "N/A", "J…
$ agency_type_name      <chr> "City", "City", "State Police", "City", "Other"…
$ population_group_desc <chr> "Cities under 2,500", "Cities from 2,500 thru 9…
$ population            <dbl> 2131, 5800, 172397, 1000, 0, 8611, 2850, 975, 2…
$ male_officer_ct       <dbl> 6, 10, 0, 3, NA, 16, 6, 2, 5, NA, NA, 3, 26, 5,…
$ male_civilian_ct      <dbl> 6, 0, 0, 0, NA, 5, 0, 0, 0, NA, NA, 0, 0, 0, 4,…
$ male_total_ct         <dbl> 12, 10, 0, 3, 0, 21, 6, 2, 5, 0, 0, 3, 26, 5, 6…
$ female_officer_ct     <lgl> FALSE, FALSE, NA, FALSE, NA, FALSE, FALSE, FALS…
$ female_civilian_ct    <lgl> TRUE, NA, NA, FALSE, NA, FALSE, FALSE, FALSE, F…
$ female_total_ct       <dbl> 1, 5, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 7, 0, 13, 0…
$ officer_ct            <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ civilian_ct           <lgl> NA, NA, NA, FALSE, NA, NA, FALSE, FALSE, FALSE,…
$ total_pe_ct           <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…
$ pe_ct_per_1000        <lgl> NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA, NA,…

Now we can create a new variable called officer_total which will be the sum of these variables. We will then keep just this variable as well as the data_year, pub_agency_name, and state_abbr.

ps_data %<>%
  mutate(officer_total = male_total_ct + female_total_ct) %>%
  dplyr::select(data_year,
                pub_agency_name,
                state_abbr,
                officer_total)

ps_data

# A tibble: 932,063 x 4
   data_year pub_agency_name                            state_abbr officer_total
       <dbl> <chr>                                      <chr>              <dbl>
 1      1977 Soldotna                                   AK                    13
 2      1977 Kenai                                      AK                    15
 3      1977 Alaska State Troopers                      AK                     0
 4      1977 Trafford                                   AL                     3
 5      1977 Trussville Fire Department Fire and Explo… AL                     0
 6      1977 Atmore                                     AL                    21
 7      1977 East Brewton                               AL                     6
 8      1977 Brilliant                                  AL                     2
 9      1977 Camden                                     AL                     5
10      1977 Drug Enforcement Administration, Birmingh… AL                     0
# … with 932,053 more rows

Now we also want to get collapse by pub_agency_name to get a total count for each year and each state. So we will do this by using the group_by() function and grouping by data_year and state_abbr and using the summarise() function to calculate a sum.

ps_data %<>%
  group_by(data_year, state_abbr) %>%
  summarise(officer_state_total=sum(officer_total), .groups = "drop")

ps_data

# A tibble: 2,242 x 3
   data_year state_abbr officer_state_total
       <dbl> <chr>                    <dbl>
 1      1977 AK                         544
 2      1977 AL                        7380
 3      1977 AR                        3344
 4      1977 AS                           0
 5      1977 AZ                        6414
 6      1977 CA                       65596
 7      1977 CO                        7337
 8      1977 CT                        6051
 9      1977 CZ                           0
10      1977 DC                        4751
# … with 2,232 more rows

And we will check that we have same number of values (the number of years included in the data) for each state.

ps_data %>%
  count(state_abbr)  %>% head()

# A tibble: 6 x 2
  state_abbr     n
  <chr>      <int>
1 AK            38
2 AL            38
3 AR            38
4 AS            38
5 AZ            38
6 CA            38

ps_data %>%
  count(state_abbr) %>%
  filter(n != 38) %>%
  dim()

[1] 0 2

Looks like all the states have 38 values.

Notice also that there are some unusual abrreviations in the state_abbr variable.

We will remove data for US terroitories and associated states

Abbreviation	Territory and associated states
AS	American Samoa
GM	Guam
CZ	Canal Zone
FS	??Federated States of Micronesia (usually FM)
MP	Northern Mariana Islands
OT	??U.S. Minor Outlying Islands (usually UM)
PR	Puerto Rico
VI	Virgin Islands

state_of_interest_NULL <- c("AS",
                            "GM",
                            "CZ",
                            "FS",
                            "MP",
                            "OT",
                            "PR",
                            "VI")

ps_data <- ps_data %>%
  filter(!(state_abbr %in% state_of_interest_NULL))

Within the datasets package that is loaded with R, there is a dataset called state that contains an object called state.abb that has the state abbreviations and state.name that has the state names. We will combine these now to add the state names to our data.

state_abb_data <- tibble( "state_abbr" = state.abb, "STATE" =state.name)
head(state_abb_data)

# A tibble: 6 x 2
  state_abbr STATE     
  <chr>      <chr>     
1 AL         Alabama   
2 AK         Alaska    
3 AZ         Arizona   
4 AR         Arkansas  
5 CA         California
6 CO         Colorado

One unusual thing about this data is that NE is used for Nebraska to avoid confusions with NB in Canada. So we want to repace that using the str_replace() function of the stringr package

state_abb_data %<>%
  mutate(state_abbr = str_replace(string = state_abbr, 
                                pattern = "NE", 
                            replacement = "NB"))

# Scroll through the output!
state_abb_data %>% print(n = 50)

# A tibble: 50 x 2
   state_abbr STATE         
   <chr>      <chr>         
 1 AL         Alabama       
 2 AK         Alaska        
 3 AZ         Arizona       
 4 AR         Arkansas      
 5 CA         California    
 6 CO         Colorado      
 7 CT         Connecticut   
 8 DE         Delaware      
 9 FL         Florida       
10 GA         Georgia       
11 HI         Hawaii        
12 ID         Idaho         
13 IL         Illinois      
14 IN         Indiana       
15 IA         Iowa          
16 KS         Kansas        
17 KY         Kentucky      
18 LA         Louisiana     
19 ME         Maine         
20 MD         Maryland      
21 MA         Massachusetts 
22 MI         Michigan      
23 MN         Minnesota     
24 MS         Mississippi   
25 MO         Missouri      
26 MT         Montana       
27 NB         Nebraska      
28 NV         Nevada        
29 NH         New Hampshire 
30 NJ         New Jersey    
31 NM         New Mexico    
32 NY         New York      
33 NC         North Carolina
34 ND         North Dakota  
35 OH         Ohio          
36 OK         Oklahoma      
37 OR         Oregon        
38 PA         Pennsylvania  
39 RI         Rhode Island  
40 SC         South Carolina
41 SD         South Dakota  
42 TN         Tennessee     
43 TX         Texas         
44 UT         Utah          
45 VT         Vermont       
46 VA         Virginia      
47 WA         Washington    
48 WV         West Virginia 
49 WI         Wisconsin     
50 WY         Wyoming

We need to add DC to this. We will use the add_row() function of dplyr to do this. We just need to specify values for both of the variables.

state_abb_data %<>%
  dplyr::add_row(state_abbr = "DC",
                      STATE = "District of Columbia")

Now we will add this to our police staffing data and then remove the state_abbr variable, so that we just have state names. We will also

ps_data %<>%
  left_join(state_abb_data, by = "state_abbr") %>%
  dplyr::select(-state_abbr)
ps_data

# A tibble: 1,938 x 3
   data_year officer_state_total STATE               
       <dbl>               <dbl> <chr>               
 1      1977                 544 Alaska              
 2      1977                7380 Alabama             
 3      1977                3344 Arkansas            
 4      1977                6414 Arizona             
 5      1977               65596 California          
 6      1977                7337 Colorado            
 7      1977                6051 Connecticut         
 8      1977                4751 District of Columbia
 9      1977                1018 Delaware            
10      1977               24588 Florida             
# … with 1,928 more rows

Now we will rename the variables to match those of the other datasets.

ps_data %<>%
  rename(YEAR = "data_year",
         VALUE = "officer_state_total") %>%
  mutate(VARIABLE = "officer_state_total")
ps_data

# A tibble: 1,938 x 4
    YEAR VALUE STATE                VARIABLE           
   <dbl> <dbl> <chr>                <chr>              
 1  1977   544 Alaska               officer_state_total
 2  1977  7380 Alabama              officer_state_total
 3  1977  3344 Arkansas             officer_state_total
 4  1977  6414 Arizona              officer_state_total
 5  1977 65596 California           officer_state_total
 6  1977  7337 Colorado             officer_state_total
 7  1977  6051 Connecticut          officer_state_total
 8  1977  4751 District of Columbia officer_state_total
 9  1977  1018 Delaware             officer_state_total
10  1977 24588 Florida              officer_state_total
# … with 1,928 more rows

We also need to adjust the value to be that of every 100,000 people in the state. To do so we need the population for each state, which lukily we already have. We will slightly modify the population data and create a new tibble that will make it more clear how we are dividing by it.

denominator_temp <- population_data %>%
 select(-VARIABLE) %>%
  rename("Population_temp"=VALUE)
head(denominator_temp)

# A tibble: 6 x 3
   YEAR STATE      Population_temp
  <dbl> <chr>                <dbl>
1  1977 Alabama            3782571
2  1977 Alaska              397220
3  1977 Arizona            2427296
4  1977 Arkansas           2207195
5  1977 California        22350332
6  1977 Colorado           2696179

ps_data %<>%
  left_join(denominator_temp, by=c("STATE","YEAR"))
head(ps_data)

# A tibble: 6 x 5
   YEAR VALUE STATE      VARIABLE            Population_temp
  <dbl> <dbl> <chr>      <chr>                         <dbl>
1  1977   544 Alaska     officer_state_total          397220
2  1977  7380 Alabama    officer_state_total         3782571
3  1977  3344 Arkansas   officer_state_total         2207195
4  1977  6414 Arizona    officer_state_total         2427296
5  1977 65596 California officer_state_total        22350332
6  1977  7337 Colorado   officer_state_total         2696179

Avocado not sure why the lag?- could use inside plm function…- conceptually I get why you might want to know how staffing has changed recently… but this does not seem to calculate that…hmmmm

ps_data %<>%
  mutate(VALUE = (VALUE * 100000) / Population_temp) %>%
  #mutate(VALUE = lag(VALUE)) %>%
  mutate(VARIABLE = "police_per_100k_lag") %>%
  select(-Population_temp)

ps_data

# A tibble: 1,938 x 4
    YEAR VALUE STATE                VARIABLE           
   <dbl> <dbl> <chr>                <chr>              
 1  1977  137. Alaska               police_per_100k_lag
 2  1977  195. Alabama              police_per_100k_lag
 3  1977  152. Arkansas             police_per_100k_lag
 4  1977  264. Arizona              police_per_100k_lag
 5  1977  293. California           police_per_100k_lag
 6  1977  272. Colorado             police_per_100k_lag
 7  1977  196. Connecticut          police_per_100k_lag
 8  1977  697. District of Columbia police_per_100k_lag
 9  1977  171. Delaware             police_per_100k_lag
10  1977  277. Florida              police_per_100k_lag
# … with 1,928 more rows

Unemployment

The first thing we need to do with the unemployment data is combine the data across the different states. We can do that using the bind_rows() function of dplyr which appends the data together based on the presence of columns with the same name in the different tibbles. We will use the map_df() function of the purrr package to allow us to do this across each tibble in our list. We will then select just the annual data for each state and year and we will rename our variables to be consistent with some of other data that we are working with. Thus we would like our variables to be YEAR, VALUE and VARIABLE in all caps.

ue_rate_data <- ue_rate_data %>%
  map_df(bind_rows, .id = "STATE")

head(ue_rate_data)

# A tibble: 6 x 15
  STATE   Year   Jan   Feb   Mar   Apr   May   Jun   Jul   Aug   Sep   Oct   Nov
  <chr>  <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl> <dbl>
1 Alaba…  1977   7.5   9     7.7   7.2   6.8   8.6   8     7.8   6.7   6.3   6.3
2 Alaba…  1978   7.1   6.9   6.2   5.4   5.1   6.9   6.7   6.7   6.5   6.3   6.3
3 Alaba…  1979   6.7   7.5   6.9   6.6   6.4   8.4   7.7   7.8   7.1   7.2   6.9
4 Alaba…  1980   7.7   7.8   7.4   7.4   8.4   9.7  10.4  10.3   9.3   9.6   9.4
5 Alaba…  1981  10    10.3   9.5   9.1   9.4  11.1  10.4  10.9  10.8  11.7  11.5
6 Alaba…  1982  13.2  13.2  12.9  12.6  12.8  14.5  14.7  14.8  14.7  15.1  15.4
# … with 2 more variables: Dec <dbl>, Annual <dbl>

ue_rate_data <- ue_rate_data %>%
  dplyr::select(STATE, Year, Annual) %>%
  rename("YEAR" = Year,
        "VALUE" = Annual) %>%
  mutate(VARIABLE = "Unemployment_rate")

head(ue_rate_data)

# A tibble: 6 x 4
  STATE    YEAR VALUE VARIABLE         
  <chr>   <dbl> <dbl> <chr>            
1 Alabama  1977   7.3 Unemployment_rate
2 Alabama  1978   6.4 Unemployment_rate
3 Alabama  1979   7.2 Unemployment_rate
4 Alabama  1980   8.9 Unemployment_rate
5 Alabama  1981  10.6 Unemployment_rate
6 Alabama  1982  14.1 Unemployment_rate

Poverty rate

Click here to see details about how the poverty data was wrangled

OK, now for wrangling the poverty data. First let’s take a look at it.

head(poverty_rate_data)

# A tibble: 6 x 6
  `NOTE: Number in thousa… ...2  ...3   ...4         ...5         ...6          
  <chr>                    <chr> <chr>  <chr>        <chr>        <chr>         
1 2018                     <NA>  <NA>    <NA>        <NA>          <NA>         
2 STATE                    Total Number "Standard\n… Percent      "Standard\ner…
3 Alabama                  4877  779    "65"         16           "1.3"         
4 Alaska                   720   94     "9"          13.1         "1.2"         
5 Arizona                  7241  929    "80"         12.80000000… "1.1000000000…
6 Arkansas                 2912  462    "38"         15.9         "1.3"

We can see that the column names are actually shifted downbelow the row with the year. So we will manually make these values the actual column names.

colnames(poverty_rate_data) <- c("STATE",
                                 "Total",
                                 "Number",
                                 "Number_se",
                                 "Percent",
                                 "Percent_se")

poverty_rate_data2 <-poverty_rate_data

Let’s also remove the rows where the column names are listed, like row number 2.

poverty_rate_data  %<>%
  filter(STATE != "STATE")
head(poverty_rate_data)

# A tibble: 6 x 6
  STATE      Total Number Number_se Percent            Percent_se        
  <chr>      <chr> <chr>  <chr>     <chr>              <chr>             
1 2018       <NA>  <NA>   <NA>      <NA>               <NA>              
2 Alabama    4877  779    65        16                 1.3               
3 Alaska     720   94     9         13.1               1.2               
4 Arizona    7241  929    80        12.800000000000001 1.1000000000000001
5 Arkansas   2912  462    38        15.9               1.3               
6 California 39150 4664   184       11.9               0.5

We can also see that there are some extra notes at the end of our data. This is why it is a good idea to look at both the head and tail of your data.

tail(poverty_rate_data)

# A tibble: 6 x 6
  STATE                             Total Number Number_se Percent Percent_se   
  <chr>                             <chr> <chr>  <chr>     <chr>   <chr>        
1 Wisconsin                         4724  403    57        8.5     1.1000000000…
2 Wyoming                           468   49     20        10.4    4            
3 Standard errors shown in this ta… <NA>  <NA>   <NA>      <NA>    <NA>         
4 For information on confidentiali… <NA>  <NA>   <NA>      <NA>    <NA>         
5 Footnotes are available at <www.… <NA>  <NA>   <NA>      <NA>    <NA>         
6 SOURCE: U.S. Bureau of the Censu… <NA>  <NA>   <NA>      <NA>    <NA>

We can see that the strings for the state for these rows are very long. We can also see that there are rows that just have the year, where the state is only 4 characters long. We will create a new variable called length_state based on the number of characters in the STATE values. We will use the str_length() function of the stringr package. We need to use the map_dbl() function to apply this to each row of the STATE variable. The map() function creates a list, whereas the map_dbl() function creates a vector of class double. If we were to use map() we would need to use unlist() and pull().

poverty_rate_data %<>%
 mutate(length_state = map_dbl(STATE, str_length))

# Alternatively with map()
#poverty_rate_data %<>%
#mutate(length_state = unlist(map(pull(poverty_rate_data, STATE), str_length)))

poverty_rate_data

# A tibble: 2,136 x 7
   STATE         Total Number Number_se Percent      Percent_se     length_state
   <chr>         <chr> <chr>  <chr>     <chr>        <chr>                 <dbl>
 1 2018          <NA>  <NA>   <NA>      <NA>         <NA>                      4
 2 Alabama       4877  779    65        16           1.3                       7
 3 Alaska        720   94     9         13.1         1.2                       6
 4 Arizona       7241  929    80        12.80000000… 1.10000000000…            7
 5 Arkansas      2912  462    38        15.9         1.3                       8
 6 California    39150 4664   184       11.9         0.5                      10
 7 Colorado      5739  521    51        9.099999999… 0.90000000000…            8
 8 Connecticut   3413  348    43        10.19999999… 1.3                      11
 9 Delaware      976   72     9         7.400000000… 1                         8
10 District of … 692   102    8         14.69999999… 1.10000000000…           20
# … with 2,126 more rows

Great, now let’s look at the tail with our new variable length_state

tail(pull(poverty_rate_data, length_state))

[1]   9   7 285 164 129 101

poverty_rate_data %<>% 
  filter(length_state <100)

tail(poverty_rate_data)

# A tibble: 6 x 7
  STATE       Total Number Number_se Percent        Percent_se      length_state
  <chr>       <chr> <chr>  <chr>     <chr>          <chr>                  <dbl>
1 Vermont     520   62     22        12             4                          7
2 Virginia    5204  647    72        12.4           1.3                        8
3 Washington  4223  538    65        12.6999999999… 1.399999999999…           10
4 West Virgi… 1952  297    49        15.1999999999… 2.299999999999…           13
5 Wisconsin   4724  403    57        8.5            1.100000000000…            9
6 Wyoming     468   49     20        10.4           4                          7

Looks good!

Now let’s select all the states that are actually year values to create a new variable about the year. We can do so by using the str_detect() function of the stringr package to look for digits or values of 0-9. This is indicated by using the "[:digit:]".

As you can see in the RStudio cheatsheet about regular expressions this notation indicates any digit between 0 and 9.

knitr::include_graphics(here("img", "regex.png"))

# Scroll through the output!
poverty_rate_data %>% 
  filter(str_detect(STATE, "[:digit:]")) %>%
  print(n = 51)

# A tibble: 41 x 7
   STATE     Total Number Number_se Percent Percent_se length_state
   <chr>     <chr> <chr>  <chr>     <chr>   <chr>             <dbl>
 1 2018      <NA>  <NA>   <NA>      <NA>    <NA>                  4
 2 2017 (21) <NA>  <NA>   <NA>      <NA>    <NA>                  9
 3 2017      <NA>  <NA>   <NA>      <NA>    <NA>                  4
 4 2016      <NA>  <NA>   <NA>      <NA>    <NA>                  4
 5 2015      <NA>  <NA>   <NA>      <NA>    <NA>                  4
 6 2014      <NA>  <NA>   <NA>      <NA>    <NA>                  4
 7 2013 (19) <NA>  <NA>   <NA>      <NA>    <NA>                  9
 8 2013 (18) <NA>  <NA>   <NA>      <NA>    <NA>                  9
 9 2012      <NA>  <NA>   <NA>      <NA>    <NA>                  4
10 2011      <NA>  <NA>   <NA>      <NA>    <NA>                  4
11 2010 (17) <NA>  <NA>   <NA>      <NA>    <NA>                  9
12 2009      <NA>  <NA>   <NA>      <NA>    <NA>                  4
13 2008      <NA>  <NA>   <NA>      <NA>    <NA>                  4
14 2007      <NA>  <NA>   <NA>      <NA>    <NA>                  4
15 2006      <NA>  <NA>   <NA>      <NA>    <NA>                  4
16 2005      <NA>  <NA>   <NA>      <NA>    <NA>                  4
17 2004 (14) <NA>  <NA>   <NA>      <NA>    <NA>                  9
18 2003      <NA>  <NA>   <NA>      <NA>    <NA>                  4
19 2002      <NA>  <NA>   <NA>      <NA>    <NA>                  4
20 2001      <NA>  <NA>   <NA>      <NA>    <NA>                  4
21 2000 (12) <NA>  <NA>   <NA>      <NA>    <NA>                  9
22 1999 (11) <NA>  <NA>   <NA>      <NA>    <NA>                  9
23 1998      <NA>  <NA>   <NA>      <NA>    <NA>                  4
24 1997      <NA>  <NA>   <NA>      <NA>    <NA>                  4
25 1996      <NA>  <NA>   <NA>      <NA>    <NA>                  4
26 1995      <NA>  <NA>   <NA>      <NA>    <NA>                  4
27 1994      <NA>  <NA>   <NA>      <NA>    <NA>                  4
28 1993 (10) <NA>  <NA>   <NA>      <NA>    <NA>                  9
29 1992 (9)  <NA>  <NA>   <NA>      <NA>    <NA>                  8
30 1991 (8)  <NA>  <NA>   <NA>      <NA>    <NA>                  8
31 1990      <NA>  <NA>   <NA>      <NA>    <NA>                  4
32 1989      <NA>  <NA>   <NA>      <NA>    <NA>                  4
33 1988      <NA>  <NA>   <NA>      <NA>    <NA>                  4
34 1987 (7)  <NA>  <NA>   <NA>      <NA>    <NA>                  8
35 1986      <NA>  <NA>   <NA>      <NA>    <NA>                  4
36 1985      <NA>  <NA>   <NA>      <NA>    <NA>                  4
37 1984      <NA>  <NA>   <NA>      <NA>    <NA>                  4
38 1983 (6)  <NA>  <NA>   <NA>      <NA>    <NA>                  8
39 1982      <NA>  <NA>   <NA>      <NA>    <NA>                  4
40 1981 (5)  <NA>  <NA>   <NA>      <NA>    <NA>                  8
41 1980      <NA>  <NA>   <NA>      <NA>    <NA>                  4

Some of the years (2013 and 2017) are listed twice with a number in parantheses, others are just listed once with a number in parantheses. Looking at the technical documentation, this seems to do with updates to the defition of poverty and to the methods used to estimate poverty levels. See here and here for more information. We will simply select one of the sets of data for 2013 and 2017.

poverty_rate_data %>% 
  filter(str_detect(STATE, "2013")) %>%
  filter(str_detect(STATE, "2017"))

# A tibble: 0 x 7
# … with 7 variables: STATE <chr>, Total <chr>, Number <chr>, Number_se <chr>,
#   Percent <chr>, Percent_se <chr>, length_state <dbl>

First let’s add the year value to our data.

There should be consistently data for 51 states (including DC). We can see that sometimes DC is spelled out and sometimes it is not.

### Scroll through the output!
poverty_rate_data %>% 
  filter(str_detect(STATE, "[:alpha:]")) %>%
  distinct(STATE) %>% print(n = 100)

# A tibble: 52 x 1
   STATE               
   <chr>               
 1 Alabama             
 2 Alaska              
 3 Arizona             
 4 Arkansas            
 5 California          
 6 Colorado            
 7 Connecticut         
 8 Delaware            
 9 District of Columbia
10 Florida             
11 Georgia             
12 Hawaii              
13 Idaho               
14 Illinois            
15 Indiana             
16 Iowa                
17 Kansas              
18 Kentucky            
19 Louisiana           
20 Maine               
21 Maryland            
22 Massachusetts       
23 Michigan            
24 Minnesota           
25 Mississippi         
26 Missouri            
27 Montana             
28 Nebraska            
29 Nevada              
30 New Hampshire       
31 New Jersey          
32 New Mexico          
33 New York            
34 North Carolina      
35 North Dakota        
36 Ohio                
37 Oklahoma            
38 Oregon              
39 Pennsylvania        
40 Rhode Island        
41 South Carolina      
42 South Dakota        
43 Tennessee           
44 Texas               
45 Utah                
46 Vermont             
47 Virginia            
48 Washington          
49 West Virginia       
50 Wisconsin           
51 Wyoming             
52 D.C.

Now we will replace "D.C." with "District of Columbia" using str_replace(). We can use the tally() function of the dplyr package to check that we have fewer now.

poverty_rate_data %<>% 
mutate(STATE = str_replace(STATE, pattern = "D.C.", 
                              replacement = "District of Columbia" ))

poverty_rate_data %>% 
  filter(str_detect(STATE, "[:alpha:]")) %>%
  distinct(STATE) %>% tally()

# A tibble: 1 x 1
      n
  <int>
1    51

Great! Now are each of the states occurring as often as the unique year values? We can first check how many year values there are. Then can use the count() function of the dplyr package to check how often the states are repeated.

poverty_rate_data %>% 
  filter(str_detect(STATE, "[:digit:]")) %>%
  tally()

# A tibble: 1 x 1
      n
  <int>
1    41

There are 41 different sets of data according to year values.

### Scroll through the output!
poverty_rate_data %>% 
  filter(str_detect(STATE, "[:alpha:]")) %>%
  count(STATE) %>% 
  print(n = 51)

# A tibble: 51 x 2
   STATE                    n
   <chr>                <int>
 1 Alabama                 41
 2 Alaska                  41
 3 Arizona                 41
 4 Arkansas                41
 5 California              41
 6 Colorado                41
 7 Connecticut             41
 8 Delaware                41
 9 District of Columbia    41
10 Florida                 41
11 Georgia                 41
12 Hawaii                  41
13 Idaho                   41
14 Illinois                41
15 Indiana                 41
16 Iowa                    41
17 Kansas                  41
18 Kentucky                41
19 Louisiana               41
20 Maine                   41
21 Maryland                41
22 Massachusetts           41
23 Michigan                41
24 Minnesota               41
25 Mississippi             41
26 Missouri                41
27 Montana                 41
28 Nebraska                41
29 Nevada                  41
30 New Hampshire           41
31 New Jersey              41
32 New Mexico              41
33 New York                41
34 North Carolina          41
35 North Dakota            41
36 Ohio                    41
37 Oklahoma                41
38 Oregon                  41
39 Pennsylvania            41
40 Rhode Island            41
41 South Carolina          41
42 South Dakota            41
43 Tennessee               41
44 Texas                   41
45 Utah                    41
46 Vermont                 41
47 Virginia                41
48 Washington              41
49 West Virginia           41
50 Wisconsin               41
51 Wyoming                 41

Indeed, looks like each of the states are repeated the same number of times!

Now let’s create a new variable YEAR that repeats the year values for all of the different states and for the row that has just the year value for a total of 52.

year_values <- poverty_rate_data %>% 
  filter(str_detect(STATE, "[:digit:]")) %>%
  distinct(STATE)

  year_values<-rep(pull(year_values, STATE), each = 52)
setequal(length(year_values), length(poverty_rate_data$STATE))

[1] TRUE

Now we will add this to our poverty_rate_data. We will also remove the length_state variable using the select() function of the dplyr package and a minus sign before the variable name.

poverty_rate_data %<>%
  mutate(year_value = year_values) %>%
  select(-length_state)

#Scroll through the output!
poverty_rate_data %>% print(n = 100)

# A tibble: 2,132 x 7
    STATE         Total Number Number_se Percent       Percent_se     year_value
    <chr>         <chr> <chr>  <chr>     <chr>         <chr>          <chr>     
  1 2018          <NA>  <NA>   <NA>      <NA>          <NA>           2018      
  2 Alabama       4877  779    65        16            1.3            2018      
  3 Alaska        720   94     9         13.1          1.2            2018      
  4 Arizona       7241  929    80        12.800000000… 1.10000000000… 2018      
  5 Arkansas      2912  462    38        15.9          1.3            2018      
  6 California    39150 4664   184       11.9          0.5            2018      
  7 Colorado      5739  521    51        9.0999999999… 0.90000000000… 2018      
  8 Connecticut   3413  348    43        10.199999999… 1.3            2018      
  9 Delaware      976   72     9         7.4000000000… 1              2018      
 10 District of … 692   102    8         14.699999999… 1.10000000000… 2018      
 11 Florida       21117 2883   173       13.699999999… 0.80000000000… 2018      
 12 Georgia       10423 1548   115       14.800000000… 1.10000000000… 2018      
 13 Hawaii        1393  128    16        9.1999999999… 1.10000000000… 2018      
 14 Idaho         1766  202    25        11.5          1.39999999999… 2018      
 15 Illinois      12589 1292   130       10.300000000… 1              2018      
 16 Indiana       6582  761    68        11.6          1              2018      
 17 Iowa          3110  277    30        8.9000000000… 1              2018      
 18 Kansas        2835  212    27        7.5           0.90000000000… 2018      
 19 Kentucky      4445  696    76        15.699999999… 1.7            2018      
 20 Louisiana     4510  858    38        19            0.80000000000… 2018      
 21 Maine         1321  153    19        11.6          1.39999999999… 2018      
 22 Maryland      6030  480    50        8             0.80000000000… 2018      
 23 Massachusetts 6883  601    59        8.6999999999… 0.90000000000… 2018      
 24 Michigan      9913  1036   78        10.5          0.80000000000… 2018      
 25 Minnesota     5746  456    47        7.9000000000… 0.80000000000… 2018      
 26 Mississippi   2899  567    27        19.600000000… 0.90000000000… 2018      
 27 Missouri      6026  745    81        12.4          1.3            2018      
 28 Montana       1041  107    12        10.300000000… 1.10000000000… 2018      
 29 Nebraska      1893  199    25        10.5          1.3            2018      
 30 Nevada        3008  390    37        13            1.2            2018      
 31 New Hampshire 1349  82     11        6.0999999999… 0.80000000000… 2018      
 32 New Jersey    8790  725    65        8.1999999999… 0.69999999999… 2018      
 33 New Mexico    2054  342    27        16.600000000… 1.3            2018      
 34 New York      19343 2145   110       11.1          0.59999999999… 2018      
 35 North Caroli… 10369 1355   96        13.1          0.90000000000… 2018      
 36 North Dakota  745   72     9         9.6999999999… 1.2            2018      
 37 Ohio          11452 1365   115       11.9          1              2018      
 38 Oklahoma      3858  518    48        13.4          1.2            2018      
 39 Oregon        4172  404    45        9.6999999999… 1.10000000000… 2018      
 40 Pennsylvania  12519 1476   124       11.800000000… 1              2018      
 41 Rhode Island  1036  92     15        8.9000000000… 1.39999999999… 2018      
 42 South Caroli… 5036  642    45        12.800000000… 0.90000000000… 2018      
 43 South Dakota  853   90     8         10.6          0.90000000000… 2018      
 44 Tennessee     6665  800    73        12            1.10000000000… 2018      
 45 Texas         28497 3894   173       13.699999999… 0.59999999999… 2018      
 46 Utah          3173  219    37        6.9000000000… 1.2            2018      
 47 Vermont       616   60     7         9.6999999999… 1.10000000000… 2018      
 48 Virginia      8393  821    86        9.8000000000… 1              2018      
 49 Washington    7555  647    101       8.5999999999… 1.3            2018      
 50 West Virginia 1762  279    21        15.9          1.2            2018      
 51 Wisconsin     5795  499    54        8.5999999999… 0.90000000000… 2018      
 52 Wyoming       565   53     6         9.5           1.10000000000… 2018      
 53 2017 (21)     <NA>  <NA>   <NA>      <NA>          <NA>           2017 (21) 
 54 Alabama       4801  735    58        15.300000000… 1.2            2017 (21) 
 55 Alaska        719   87     12        12.1          1.7            2017 (21) 
 56 Arizona       6981  951    104       13.6          1.5            2017 (21) 
 57 Arkansas      2921  436    33        14.9          1.10000000000… 2017 (21) 
 58 California    39247 4759   182       12.1          0.5            2017 (21) 
 59 Colorado      5527  489    51        8.9000000000… 0.90000000000… 2017 (21) 
 60 Connecticut   3553  377    43        10.6          1.2            2017 (21) 
 61 Delaware      967   85     10        8.8000000000… 1.10000000000… 2017 (21) 
 62 District of … 691   96     8         13.9          1.10000000000… 2017 (21) 
 63 Florida       20909 2809   173       13.4          0.80000000000… 2017 (21) 
 64 Georgia       10231 1339   104       13.1          1              2017 (21) 
 65 Hawaii        1402  149    17        10.6          1.2            2017 (21) 
 66 Idaho         1730  199    23        11.5          1.3            2017 (21) 
 67 Illinois      12597 1454   102       11.5          0.80000000000… 2017 (21) 
 68 Indiana       6532  762    70        11.699999999… 1.10000000000… 2017 (21) 
 69 Iowa          3053  230    33        7.5           1.10000000000… 2017 (21) 
 70 Kansas        2868  411    33        14.300000000… 1.2            2017 (21) 
 71 Kentucky      4395  591    76        13.5          1.7            2017 (21) 
 72 Louisiana     4535  931    48        20.5          1.10000000000… 2017 (21) 
 73 Maine         1315  163    19        12.4          1.39999999999… 2017 (21) 
 74 Maryland      5977  451    58        7.5999999999… 1              2017 (21) 
 75 Massachusetts 6784  763    71        11.199999999… 1              2017 (21) 
 76 Michigan      9895  1135   88        11.5          0.90000000000… 2017 (21) 
 77 Minnesota     5619  479    57        8.5           1              2017 (21) 
 78 Mississippi   2948  544    27        18.5          0.90000000000… 2017 (21) 
 79 Missouri      5988  683    81        11.4          1.39999999999… 2017 (21) 
 80 Montana       1041  107    11        10.300000000… 1              2017 (21) 
 81 Nebraska      1878  216    25        11.5          1.3            2017 (21) 
 82 Nevada        2979  392    37        13.199999999… 1.2            2017 (21) 
 83 New Hampshire 1333  95     13        7.2000000000… 1              2017 (21) 
 84 New Jersey    9015  894    95        9.9000000000… 1.10000000000… 2017 (21) 
 85 New Mexico    2035  402    28        19.699999999… 1.39999999999… 2017 (21) 
 86 New York      19735 2510   141       12.699999999… 0.69999999999… 2017 (21) 
 87 North Caroli… 10297 1567   96        15.199999999… 0.90000000000… 2017 (21) 
 88 North Dakota  740   92     11        12.4          1.5            2017 (21) 
 89 Ohio          11491 1479   98        12.9          0.90000000000… 2017 (21) 
 90 Oklahoma      3817  490    47        12.800000000… 1.2            2017 (21) 
 91 Oregon        4202  482    55        11.5          1.3            2017 (21) 
 92 Pennsylvania  12568 1373   94        10.9          0.80000000000… 2017 (21) 
 93 Rhode Island  1046  118    15        11.300000000… 1.39999999999… 2017 (21) 
 94 South Caroli… 4955  756    55        15.199999999… 1.10000000000… 2017 (21) 
 95 South Dakota  870   93     15        10.699999999… 1.7            2017 (21) 
 96 Tennessee     6699  759    65        11.300000000… 1              2017 (21) 
 97 Texas         28090 3715   186       13.199999999… 0.69999999999… 2017 (21) 
 98 Utah          3130  272    34        8.6999999999… 1.10000000000… 2017 (21) 
 99 Vermont       613   53     6         8.5999999999… 1              2017 (21) 
100 Virginia      8242  862    71        10.5          0.90000000000… 2017 (21) 
# … with 2,032 more rows

Looks good! Now we will remove the rows that have just the year values by only preserving those with alpha characters.

poverty_rate_data %<>%
    filter(str_detect(STATE, "[:alpha:]"))

Now let’s remove the older data for 2013 and 2017 which is the data that appears lower in the tibble.

poverty_rate_data %<>%
filter(year_value != "2017") %>%
filter(year_value != "2013 (18)")

We also want to just keep the first 4 digits of the year_value and create a YEAR variable. We need to pull the year_value data because str_sub() expects a character vector not a tibble.

poverty_rate_data %<>%
  mutate(YEAR = str_sub(pull(., year_value), start = 1, end=4))

poverty_rate_data

# A tibble: 1,989 x 8
   STATE       Total Number Number_se Percent     Percent_se    year_value YEAR 
   <chr>       <chr> <chr>  <chr>     <chr>       <chr>         <chr>      <chr>
 1 Alabama     4877  779    65        16          1.3           2018       2018 
 2 Alaska      720   94     9         13.1        1.2           2018       2018 
 3 Arizona     7241  929    80        12.8000000… 1.1000000000… 2018       2018 
 4 Arkansas    2912  462    38        15.9        1.3           2018       2018 
 5 California  39150 4664   184       11.9        0.5           2018       2018 
 6 Colorado    5739  521    51        9.09999999… 0.9000000000… 2018       2018 
 7 Connecticut 3413  348    43        10.1999999… 1.3           2018       2018 
 8 Delaware    976   72     9         7.40000000… 1             2018       2018 
 9 District o… 692   102    8         14.6999999… 1.1000000000… 2018       2018 
10 Florida     21117 2883   173       13.6999999… 0.8000000000… 2018       2018 
# … with 1,979 more rows

Looks good! Now we will just remove the extra variables and rename the variables we want to keep to be similar to our other data.

poverty_rate_data %<>%
  dplyr::select(- Number,
                - Number_se,
                - Percent_se,
                - Total,
                - year_value) %>%
  rename("VALUE" = Percent) %>%
  mutate(VARIABLE = "Poverty_rate",
         YEAR = as.numeric(YEAR),
         VALUE = as.numeric(VALUE))
head(poverty_rate_data)

# A tibble: 6 x 4
  STATE      VALUE  YEAR VARIABLE    
  <chr>      <dbl> <dbl> <chr>       
1 Alabama     16    2018 Poverty_rate
2 Alaska      13.1  2018 Poverty_rate
3 Arizona     12.8  2018 Poverty_rate
4 Arkansas    15.9  2018 Poverty_rate
5 California  11.9  2018 Poverty_rate
6 Colorado     9.1  2018 Poverty_rate

Looks great! AVOCADO this data is per 1000k? I think I need to restrict to 2014 to match the other data and thats why I get an error when making the Donohue_df

From Michael:

poverty_rate_data <-poverty_rate_data2
notes <- 4

poverty_rate_data2 <- poverty_rate_data[-((dim(poverty_rate_data)[1]-notes+1):dim(poverty_rate_data)[1]),]

states_eq <- 51

extra_col <- 2

rep_rows <- states_eq + extra_col

groups <- (dim(poverty_rate_data)[1])/(rep_rows)

paste(groups - (2018-1980 + 1), "extra groups")

poverty_rate_data$year_group <- rep(1:groups, each=rep_rows)

poverty_rate_data <- poverty_rate_data %>%
  group_by(year_group) %>%
  group_split()

head(poverty_rate_data[[1]])

poverty_rate_data <- poverty_rate_data %>%
  map(~mutate(.,
              row_id = row_number())) %>%
  map(~filter(.,row_id != 2)) %>%
  map(~dplyr::select(.,-row_id))

poverty_rate_data_names <- poverty_rate_data %>%
  sapply(., "[",1,1, drop=TRUE) %>%
  str_replace_all(.,"[:space:]","_")

names(poverty_rate_data) <- poverty_rate_data_names

# Recall 2 extra groups. 
# footnotes available at https://www.census.gov/topics/income-poverty/poverty/guidance/poverty-footnotes/cps-historic-footnotes.html

poverty_rate_data$`2017_(21)` <- NULL

poverty_rate_data$`2013_(19)` <- NULL

poverty_rate_data_names <- poverty_rate_data %>%
  sapply(., "[",1,1, drop=TRUE) %>%
  str_sub(., start = 1, end=4)

names(poverty_rate_data) <- poverty_rate_data_names

poverty_rate_data <- poverty_rate_data %>%
  map_df(bind_rows, .id = "YEAR") %>%
  dplyr::select(-year_group)

poverty_rate_data <- poverty_rate_data %>%
    mutate(n_na = rowSums(is.na(.))) 

# This shows that there is systematic missing values stemmingly *solely* from the rows without poverty data and only a label designating the year
poverty_rate_data %>% 
  group_by(n_na) %>%
  tally()

sapply(poverty_rate_data, class)



colnames(poverty_rate_data)

Violent crime

Click here to see details about how the violent crime data was wrangled

The crime_data was importated using read_lines() and we have some lines that we don’t necessarily need. A large amount of the original data is notes at the end of the table. We want to remove these lines. We can determine where they start by searching for the row that contains the first statement of these notes using the str_which() function of the stringr package. We will subtract one from this as there is a blank line in between.

tail(crime_data)

[1] ",,\"Vermont - The state UCR Program was unable to provide complete 1997 offense figures in accordance with UCR guidelines.  The 1996 and 1997 percent changes within the geographic division in which Vermont is categorized were applied to the valid 1996 state total to effect the 1997 state total.\""                                                                                                              
[2] "  "                                                                                                                                                                                                                                                                                                                                                                                                                     
[3] " "                                                                                                                                                                                                                                                                                                                                                                                                                      
[4] ",,\"Wisconsin - The state UCR Program was unable to provide complete 1998 offense figures in accordance with UCR guidelines.  The state total was estimated by using 1997 figures for the nonreporting areas and applying 1997 versus 1998 percentage changes for the division in which Wisconsin is located.  The estimates for the nonreporting areas were then increased by any actual 1998 crime counts received.\""
[5] " "                                                                                                                                                                                                                                                                                                                                                                                                                      
[6] "\"Sources: FBI, Uniform Crime Reports, prepared by the National Archive of Criminal Justice Data\" "

crime_data <- crime_data[-((str_which(crime_data, "The figures shown in this column for the offense of rape were estimated using the legacy UCR definition of rape")-1): length(crime_data))]
#crime_data <- crime_data[-(2143:length(crime_data))]
tail(crime_data)

[1] "2009,     544270,       1196,          11,         172,,          78,         935 "            
[2] "2010,     564554,       1117,           8,         162,,          77,         870 "            
[3] "2011,     567356,       1245,          18,         146,,          71,       1010 "             
[4] "2012,     576626,       1161,          14,         154,,          61,         932 "            
[5] "2013,     583223,       1212,          17,         144,         204,          74,         917 "
[6] "2014,     584153,       1142,          16,         126,         174,          53,         899 "

There are lines for each year from 1977 to 2014 as well as four lines about each state and the header information for each state. Here you can see what the orginal data looks like:

knitr::include_graphics(here("img", "crime_data.png"))

We want to delete the header information and only retain the lines numeric values or state names. Thus since there are 38 years worth of data for each state and 4 lines for each header, then each state has 42 lines. We want to delete the lines between and including line 2 to 4 for each state. We will save the header information once to use later.

head(crime_data)

[1] "Estimated crime in Alabama"                                                                                                           
[2] "\n,,National or state crime,,,,,,,"                                                                                                   
[3] "\n,,Violent crime,,,,,,,"                                                                                                             
[4] "\nYear,Population,Violent crime total,Murder and nonnegligent Manslaughter,Legacy rape /1,Revised rape /2,Robbery,Aggravated assault,"
[5] "1977,   3690000,      15293,         524,         929,,       3572,      10268 "                                                      
[6] "1978,   3742000,      15682,         499,         954,,       3708,      10521 "

x <- 2014-1977+1
rep_cycle <- 4 + x
rep_cycle_cut <- 2 + x
colnames_crime<-(crime_data[4])

So starting at line 2 and and 3 and 4 we create a sequence of numbers that increase by the number of rows of the length of the individual state data. We can do so using the base seq() function. We can take a look at these in order using the base sort() function.

delete_rows <- c(seq(from = 2,
                       to = length(crime_data),
                       by = rep_cycle),
                 seq(from = 3,
                       to = length(crime_data),
                       by = rep_cycle), 
                 seq(from = 4,
                       to = length(crime_data),
                       by = rep_cycle))
sort(delete_rows)

  [1]    2    3    4   44   45   46   86   87   88  128  129  130  170  171  172
 [16]  212  213  214  254  255  256  296  297  298  338  339  340  380  381  382
 [31]  422  423  424  464  465  466  506  507  508  548  549  550  590  591  592
 [46]  632  633  634  674  675  676  716  717  718  758  759  760  800  801  802
 [61]  842  843  844  884  885  886  926  927  928  968  969  970 1010 1011 1012
 [76] 1052 1053 1054 1094 1095 1096 1136 1137 1138 1178 1179 1180 1220 1221 1222
 [91] 1262 1263 1264 1304 1305 1306 1346 1347 1348 1388 1389 1390 1430 1431 1432
[106] 1472 1473 1474 1514 1515 1516 1556 1557 1558 1598 1599 1600 1640 1641 1642
[121] 1682 1683 1684 1724 1725 1726 1766 1767 1768 1808 1809 1810 1850 1851 1852
[136] 1892 1893 1894 1934 1935 1936 1976 1977 1978 2018 2019 2020 2060 2061 2062
[151] 2102 2103 2104

Thus we will delete lines 2, 3, and 4 and then skip 40 lines (to account for the state information for the first state, the lines of information for the 38 years, and then the state information for the next state) and then delete the next 3 consecutive lines and so on. We can indeed see that line 44-46 are what we wish to remove.

crime_data[44:46]

[1] "\n,,National or state crime,,,,,,,"                                                                                                   
[2] "\n,,Violent crime,,,,,,,"                                                                                                             
[3] "\nYear,Population,Violent crime total,Murder and nonnegligent Manslaughter,Legacy rape /1,Revised rape /2,Robbery,Aggravated assault,"

crime_data <- crime_data[-delete_rows]

Nice!

Now we can select all the lines that have state information. We can repeat each of these for the 38 years for each state as well as this line that contains the state information by using the base rep() function with the each = argument. Finally we will remove the "Estimated crime in " portion of the string using the str_remove() function of the stringr package. We will later combine this with the crime data.

state_label_order <-crime_data[str_which(crime_data, "Estimated crime")]
state_label_order

 [1] "Estimated crime in Alabama"             
 [2] "Estimated crime in Alaska"              
 [3] "Estimated crime in Arizona"             
 [4] "Estimated crime in Arkansas"            
 [5] "Estimated crime in California"          
 [6] "Estimated crime in Colorado"            
 [7] "Estimated crime in Connecticut"         
 [8] "Estimated crime in Delaware"            
 [9] "Estimated crime in District of Columbia"
[10] "Estimated crime in Florida"             
[11] "Estimated crime in Georgia"             
[12] "Estimated crime in Hawaii"              
[13] "Estimated crime in Idaho"               
[14] "Estimated crime in Illinois"            
[15] "Estimated crime in Indiana"             
[16] "Estimated crime in Iowa"                
[17] "Estimated crime in Kansas"              
[18] "Estimated crime in Kentucky"            
[19] "Estimated crime in Louisiana"           
[20] "Estimated crime in Maine"               
[21] "Estimated crime in Maryland"            
[22] "Estimated crime in Massachusetts"       
[23] "Estimated crime in Michigan"            
[24] "Estimated crime in Minnesota"           
[25] "Estimated crime in Mississippi"         
[26] "Estimated crime in Missouri"            
[27] "Estimated crime in Montana"             
[28] "Estimated crime in Nebraska"            
[29] "Estimated crime in Nevada"              
[30] "Estimated crime in New Hampshire"       
[31] "Estimated crime in New Jersey"          
[32] "Estimated crime in New Mexico"          
[33] "Estimated crime in New York"            
[34] "Estimated crime in North Carolina"      
[35] "Estimated crime in North Dakota"        
[36] "Estimated crime in Ohio"                
[37] "Estimated crime in Oklahoma"            
[38] "Estimated crime in Oregon"              
[39] "Estimated crime in Pennsylvania"        
[40] "Estimated crime in Rhode Island"        
[41] "Estimated crime in South Carolina"      
[42] "Estimated crime in South Dakota"        
[43] "Estimated crime in Tennessee"           
[44] "Estimated crime in Texas"               
[45] "Estimated crime in Utah"                
[46] "Estimated crime in Vermont"             
[47] "Estimated crime in Virginia"            
[48] "Estimated crime in Washington"          
[49] "Estimated crime in West Virginia"       
[50] "Estimated crime in Wisconsin"           
[51] "Estimated crime in Wyoming"

state_label_order <- rep(state_label_order, each = 38)

crime_states <-str_remove(state_label_order, pattern = "Estimated crime in ")
head(crime_states)

[1] "Alabama" "Alabama" "Alabama" "Alabama" "Alabama" "Alabama"

Nice! Now for the rest of the data. We now need to remove the lines with the state information.

crime_data <-crime_data[-str_which(crime_data, "Estimated crime")]
head(crime_data)

[1] "1977,   3690000,      15293,         524,         929,,       3572,      10268 "
[2] "1978,   3742000,      15682,         499,         954,,       3708,      10521 "
[3] "1979,   3769000,      15578,         496,       1037,,       4127,       9918 " 
[4] "1980,   3861466,      17320,         509,       1158,,       5102,      10551 " 
[5] "1981,   3916000,      18423,         465,       1021,,       4952,      11985 " 
[6] "1982,   3943000,      17653,         417,       1026,,       4417,      11793 "

tail(crime_data)

[1] "2009,     544270,       1196,          11,         172,,          78,         935 "            
[2] "2010,     564554,       1117,           8,         162,,          77,         870 "            
[3] "2011,     567356,       1245,          18,         146,,          71,       1010 "             
[4] "2012,     576626,       1161,          14,         154,,          61,         932 "            
[5] "2013,     583223,       1212,          17,         144,         204,          74,         917 "
[6] "2014,     584153,       1142,          16,         126,         174,          53,         899 "

It appears that the data is comma separted with 8 columns. One of the middle columns often has no values, we need to fill these in with NAs. We can use the read_csv() fucntion from the readr package to do this. It turns out you don’t have to have a file, but you can also use a string our a vector.

crime_data_sep <-read_csv(crime_data, col_names = FALSE)
head(crime_data)

[1] "1977,   3690000,      15293,         524,         929,,       3572,      10268 "
[2] "1978,   3742000,      15682,         499,         954,,       3708,      10521 "
[3] "1979,   3769000,      15578,         496,       1037,,       4127,       9918 " 
[4] "1980,   3861466,      17320,         509,       1158,,       5102,      10551 " 
[5] "1981,   3916000,      18423,         465,       1021,,       4952,      11985 " 
[6] "1982,   3943000,      17653,         417,       1026,,       4417,      11793 "

Nice! Now we just need our colnames. Recall that we saved this information.

colnames_crime

[1] "\nYear,Population,Violent crime total,Murder and nonnegligent Manslaughter,Legacy rape /1,Revised rape /2,Robbery,Aggravated assault,"

colnames(crime_data_sep) <-c("Year",
                             "Population",
                             "Violent_crime_total",
                             "Murder_and_nonnegligent_Manslaughter",
                             "Legacy_rape" ,
                             "Revised_rape", 
                             "Robbery",
                             "Aggravated_assault")
head(crime_data_sep)

# A tibble: 6 x 8
   Year Population Violent_crime_t… Murder_and_nonn… Legacy_rape Revised_rape
  <dbl>      <dbl>            <dbl>            <dbl>       <dbl>        <dbl>
1  1977    3690000            15293              524         929           NA
2  1978    3742000            15682              499         954           NA
3  1979    3769000            15578              496        1037           NA
4  1980    3861466            17320              509        1158           NA
5  1981    3916000            18423              465        1021           NA
6  1982    3943000            17653              417        1026           NA
# … with 2 more variables: Robbery <dbl>, Aggravated_assault <dbl>

We also want to combine this with the state information we collected earlier. We will use the bind_cols() function of the dplyr package to do this. This requires that the data have the same number of rows.

crime_data_sep <-bind_cols(STATE =crime_states, 
          crime_data_sep)

Now we will rename the Viol_crime_count variable to be Variable and we will remove all of the other columns except for Year. We will also rename the variables to look like the other datasets.

crime_data <- crime_data_sep %>%
  mutate(VARIABLE = "Viol_crime_count") %>%
  rename("VALUE" = Violent_crime_total) %>%
  rename("YEAR" = Year) %>%
  select(YEAR,STATE, VARIABLE, VALUE)

crime_data

# A tibble: 1,938 x 4
    YEAR STATE   VARIABLE         VALUE
   <dbl> <chr>   <chr>            <dbl>
 1  1977 Alabama Viol_crime_count 15293
 2  1978 Alabama Viol_crime_count 15682
 3  1979 Alabama Viol_crime_count 15578
 4  1980 Alabama Viol_crime_count 17320
 5  1981 Alabama Viol_crime_count 18423
 6  1982 Alabama Viol_crime_count 17653
 7  1983 Alabama Viol_crime_count 16471
 8  1984 Alabama Viol_crime_count 17204
 9  1985 Alabama Viol_crime_count 18398
10  1986 Alabama Viol_crime_count 22616
# … with 1,928 more rows

from Michael:

crime_data2 <- data.frame(cbind(crime_data2, rep(1:(length(crime_data2)/rep_cycle_cut),each=rep_cycle_cut)))

colnames(crime_data) <- c("String","STATE_GROUP")

crime_data <- crime_data %>%
  group_by(STATE_GROUP) %>%
  group_split()

columns_crime_data <- 8

crime_data <- crime_data %>%
  map(~mutate(.,
               State = case_when(str_detect(String, "Estimated crime in ") ~ substring(String, nchar("Estimated crime in ")+1)),
              row_id = row_number())) %>%
  map(~fill(., State)) %>%
  map(~filter(.,row_id > 2)) %>%
  map(~mutate(.,
              String = paste0(String, ",", State))) %>%
  map(~dplyr::select(.,String)) %>%
  map(~str_split_fixed(.$String,",",columns_crime_data + 1)) %>%
  map(~data.frame(.)) %>%
  map(~rename(.,"YEAR"=X1,
              "Extra_col1"=X2,
              "VC"=X3,
              "Extra_col2"=X4,
              "Extra_col3"=X5,
              "Extra_col4"=X6,
              "Extra_col5"=X7,
              "Extra_col6"=X8,
              "STATE"=X9)) %>%
  map(~dplyr::select(.,-contains("Extra_col"))) %>%
  map(~.x %>% mutate_all(~trimws(.,which = "both"))) %>%
  map_df(bind_rows)

sapply(crime_data, class)

crime_data <- crime_data %>%
  mutate(VARIABLE = "Viol_crime_count") %>%
  rename("VALUE" = VC) %>%
  as.tibble() %>%
  mutate(YEAR = as.numeric(YEAR),
         VALUE = as.numeric(VALUE))

RTC laws

Click here to see details about how the RTC Law data was wrangled

The information about the laws for each state are located on page 62 of the Donohue, et al. article, so first we will select just this page. We can print part of the character string for this page using the utils str() function and the ncar.max argument.

DAWpaper_p_62 <- DAWpaper[[62]]
str(DAWpaper_p_62, nchar.max = 1000)

 chr "                                         Table A1: RTC Adoption Dates\n         State       Effective Date of RTC Law Fraction of Year In Effect Year of Passage RTC Date (Synthetic Controls Analysis)\n      Alabama                    1975                                                                    1975\n       Alaska                 10/1/1994                          0.252                                   1995\n       Arizona                7/17/1994                          0.460                                   1995\n      Arkansas                7/27/1995                          0.433                                   1996\n     California                  N/A                                                                        0\n      Colorado                5/17/2003                          0.627                                   2003\n    Connecticut                  1970                                                                    1970\n     "| __truncated__

We can also use the cat function to see the data printed nicely to see what we are going for.

cat(DAWpaper_p_62)

                                         Table A1: RTC Adoption Dates
         State       Effective Date of RTC Law Fraction of Year In Effect Year of Passage RTC Date (Synthetic Controls Analysis)
      Alabama                    1975                                                                    1975
       Alaska                 10/1/1994                          0.252                                   1995
       Arizona                7/17/1994                          0.460                                   1995
      Arkansas                7/27/1995                          0.433                                   1996
     California                  N/A                                                                        0
      Colorado                5/17/2003                          0.627                                   2003
    Connecticut                  1970                                                                    1970
      Delaware                   N/A                                                                        0
District of Columbia             N/A                                                                        0
       Florida                10/1/1987                          0.252                                   1988
       Georgia                8/25/1989                          0.353                                   1990
       Hawaii                    N/A                                                                        0
        Idaho                  7/1/1990                          0.504                                   1990
       Illinois                1/5/2014                                                                  2014
       Indiana                1/15/1980                          0.962                                   1980
         Iowa                  1/1/2011                          1.000                                   2011
       Kansas                  1/1/2007                          1.000                                   2007
      Kentucky                10/1/1996                          0.251                                   1997
      Louisiana               4/19/1996                          0.702                                   1996
        Maine                 9/19/1985                          0.285                                   1986
      Maryland                   N/A                                                                        0
   Massachusetts                 N/A                                                                        0
      Michigan                 7/1/2001                          0.504                                   2001
     Minnesota                5/28/2003                          0.597                                   2003
     Mississippi               7/1/1990                          0.504                                   1990
      Missouri                2/26/2004                          0.847                                   2004
      Montana                 10/1/1991                          0.252                                   1992
      Nebraska                 1/1/2007                          1.000                                   2007
       Nevada                 10/1/1995                          0.252                                   1996
  New Hampshire                  1959                                                                    1959
     New Jersey                  N/A                                                                        0
    New Mexico                 1/1/2004                          1.000                                   2004
     New York                    N/A                                                                        0
  North Carolina              12/1/1995                          0.085                                   1996
   North Dakota                8/1/1985                          0.419                                   1986
         Ohio                  4/8/2004                          0.732                                   2004
     Oklahoma                  1/1/1996                          1.000                                   1996
       Oregon                  1/1/1990                          1.000                                   1990
   Pennsylvania               6/17/1989                          0.542                                   1989
    Philadelphia             10/11/1995                          0.225                                   1996
   Rhode Island                  N/A                                                                        0
  South Carolina              8/23/1996                          0.358                                   1997
   South Dakota                7/1/1985                          0.504                                   1985
     Tennessee                10/1/1996                          0.251                                   1997
        Texas                  1/1/1996                          1.000                                   1996
         Utah                  5/1/1995                          0.671                                   1995
      Vermont                    1970                                                                    1970
       Virginia                5/5/1995                          0.660                                   1995
    Washington                   1961                                                                    1961
   West Virginia               7/7/1989                          0.488                                   1990
     Wisconsin                11/1/2011                          0.167                                   2012
      Wyoming                 10/1/1994                          0.252                                   1995
                                                             60

We can see that this is one continuous character string. We can sparate into lines based on the presence of "\n" in the string using the str_split() function of the stringr package. We need to unlist the data first, as the output of str_split() is a list. Finally, we can convert it to a tibble using the as.tibble() function of the tibble package. We also see that we don’t need the first line about the table. We can remove this with the slice() function of the dplyr package. We can also use this to remove the colnames so that we can replace them. Thus we will use slice(-(1:2)) to remove the first two lines.

So we will split and unlist() the data.

p_62 <- DAWpaper_p_62 %>%
    str_split("\n") %>%
    unlist() %>%
    dplyr::as_tibble() %>%
    slice(-(1:2))

head(p_62)

# A tibble: 6 x 1
  value                                                                         
  <chr>                                                                         
1 "      Alabama                    1975                                       …
2 "       Alaska                 10/1/1994                          0.252      …
3 "       Arizona                7/17/1994                          0.460      …
4 "      Arkansas                7/27/1995                          0.433      …
5 "     California                  N/A                                        …
6 "      Colorado                5/17/2003                          0.627      …

tail(p_62)

# A tibble: 6 x 1
  value                                                                         
  <chr>                                                                         
1 "    Washington                   1961                                       …
2 "   West Virginia               7/7/1989                          0.488      …
3 "     Wisconsin                11/1/2011                          0.167      …
4 "      Wyoming                 10/1/1994                          0.252      …
5 "                                                             60"             
6 ""

We also see by looking at the tail that we want to remove the last two lines. One is empty and the other has only 63 characters, which is the line with the page number.

p_62 %<>%
  rename(RTC = value)
p_62 %>%
  mutate(RTC = map_chr(RTC, str_length)) %>%tail()

# A tibble: 6 x 1
  RTC  
  <chr>
1 109  
2 109  
3 109  
4 109  
5 63   
6 0

p_62[53,] # physcial page 60

# A tibble: 1 x 1
  RTC                                                              
  <chr>                                                            
1 "                                                             60"

p_62[54,] # empty line

# A tibble: 1 x 1
  RTC  
  <chr>
1 ""

p_62 %<>%
    slice(-c(53:54))

Now we will try splitting by spaces. We can show the output withe the first() and nth() functions of the dplyr package.

p_62 %>% pull(RTC) %>% map(str_split, pattern = " ") %>% first()

[[1]]
 [1] ""        ""        ""        ""        ""        ""        "Alabama"
 [8] ""        ""        ""        ""        ""        ""        ""       
[15] ""        ""        ""        ""        ""        ""        ""       
[22] ""        ""        ""        ""        ""        "1975"    ""       
[29] ""        ""        ""        ""        ""        ""        ""       
[36] ""        ""        ""        ""        ""        ""        ""       
[43] ""        ""        ""        ""        ""        ""        ""       
[50] ""        ""        ""        ""        ""        ""        ""       
[57] ""        ""        ""        ""        ""        ""        ""       
[64] ""        ""        ""        ""        ""        ""        ""       
[71] ""        ""        ""        ""        ""        ""        ""       
[78] ""        ""        ""        ""        ""        ""        ""       
[85] ""        ""        ""        ""        ""        ""        ""       
[92] ""        ""        ""        "1975"

p_62 %>% pull(RTC) %>% map(str_split, pattern = " ") %>% nth( 5)

[[1]]
 [1] ""           ""           ""           ""           ""          
 [6] "California" ""           ""           ""           ""          
[11] ""           ""           ""           ""           ""          
[16] ""           ""           ""           ""           ""          
[21] ""           ""           ""           "N/A"        ""          
[26] ""           ""           ""           ""           ""          
[31] ""           ""           ""           ""           ""          
[36] ""           ""           ""           ""           ""          
[41] ""           ""           ""           ""           ""          
[46] ""           ""           ""           ""           ""          
[51] ""           ""           ""           ""           ""          
[56] ""           ""           ""           ""           ""          
[61] ""           ""           ""           ""           ""          
[66] ""           ""           ""           ""           ""          
[71] ""           ""           ""           ""           ""          
[76] ""           ""           ""           ""           ""          
[81] ""           ""           ""           ""           ""          
[86] ""           ""           ""           ""           ""          
[91] ""           ""           ""           ""           ""          
[96] "0"

Interesting, we can see that there are lots of spaces between the elements of the table and that they vary by line. For example there are 6 spaces before Alabama and 7 spaces before Alaska.

Overall, that didn’t work quite like we expected.

Recall from the cheatsheet that "\\s" indicates a space. There are also ways to specify how many spaces using curly brackets{}.

knitr::include_graphics(here("img", "regex.png"))

knitr::include_graphics(here("img", "quantifiers.png"))

The spacing appears to vary quite a bit. WE can use the str_count() function of the stringr package to see how often we have white spaces larger than 5, 10, 15, or 40 spaces.

# how often are there white spaces with more than 5 spaces
p_62 %>% 
  pull(RTC) %>% 
  map(str_count, pattern = "\\s{5,}") %>% 
  unlist()

 [1] 3 4 4 4 3 4 2 3 2 4 4 3 4 3 4 4 4 4 4 4 3 2 4 4 4 4 4 4 4 2 3 3 3 3 3 4 4 4
[39] 3 3 2 3 3 4 4 4 3 4 2 3 4 4

# how often are there white spaces with more than 10 spaces
p_62 %>% 
  pull(RTC) %>% 
  map(str_count, pattern = "\\s{10,}") %>%
  unlist()

 [1] 2 3 3 3 2 3 2 2 2 3 3 2 3 2 3 3 3 3 3 3 2 2 3 3 3 3 3 3 3 2 2 3 2 3 3 3 3 3
[39] 3 3 2 3 3 3 3 3 2 3 2 3 3 3

# how often are there white spaces with more than 15 spaces
p_62 %>% 
  pull(RTC) %>% 
  map(str_count, pattern = "\\s{15,}") %>%
  unlist()

 [1] 2 3 3 3 2 3 2 2 1 3 3 2 3 2 3 3 3 3 3 3 2 2 3 3 3 3 3 3 3 2 2 3 2 2 3 3 3 3
[39] 3 2 2 2 3 3 3 3 2 3 2 3 3 3

# how often are there white spaces with more than 40 spaces
p_62 %>% 
  pull(RTC) %>%
  map(str_count, pattern = "\\s{40,}") %>% 
  unlist()

 [1] 1 0 0 0 1 0 1 1 1 0 0 1 0 1 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 1 1 0 1 0 0 0 0 0
[39] 0 0 1 0 0 0 0 0 1 0 1 0 0 0

Rows with white spaces with more than 40 consecutive spaces is less common. It appears to be the case in the 1st and 5th row.

If we take a look at those rows we can see that this occurs when we have a missing value.

cat(DAWpaper_p_62)

                                         Table A1: RTC Adoption Dates
         State       Effective Date of RTC Law Fraction of Year In Effect Year of Passage RTC Date (Synthetic Controls Analysis)
      Alabama                    1975                                                                    1975
       Alaska                 10/1/1994                          0.252                                   1995
       Arizona                7/17/1994                          0.460                                   1995
      Arkansas                7/27/1995                          0.433                                   1996
     California                  N/A                                                                        0
      Colorado                5/17/2003                          0.627                                   2003
    Connecticut                  1970                                                                    1970
      Delaware                   N/A                                                                        0
District of Columbia             N/A                                                                        0
       Florida                10/1/1987                          0.252                                   1988
       Georgia                8/25/1989                          0.353                                   1990
       Hawaii                    N/A                                                                        0
        Idaho                  7/1/1990                          0.504                                   1990
       Illinois                1/5/2014                                                                  2014
       Indiana                1/15/1980                          0.962                                   1980
         Iowa                  1/1/2011                          1.000                                   2011
       Kansas                  1/1/2007                          1.000                                   2007
      Kentucky                10/1/1996                          0.251                                   1997
      Louisiana               4/19/1996                          0.702                                   1996
        Maine                 9/19/1985                          0.285                                   1986
      Maryland                   N/A                                                                        0
   Massachusetts                 N/A                                                                        0
      Michigan                 7/1/2001                          0.504                                   2001
     Minnesota                5/28/2003                          0.597                                   2003
     Mississippi               7/1/1990                          0.504                                   1990
      Missouri                2/26/2004                          0.847                                   2004
      Montana                 10/1/1991                          0.252                                   1992
      Nebraska                 1/1/2007                          1.000                                   2007
       Nevada                 10/1/1995                          0.252                                   1996
  New Hampshire                  1959                                                                    1959
     New Jersey                  N/A                                                                        0
    New Mexico                 1/1/2004                          1.000                                   2004
     New York                    N/A                                                                        0
  North Carolina              12/1/1995                          0.085                                   1996
   North Dakota                8/1/1985                          0.419                                   1986
         Ohio                  4/8/2004                          0.732                                   2004
     Oklahoma                  1/1/1996                          1.000                                   1996
       Oregon                  1/1/1990                          1.000                                   1990
   Pennsylvania               6/17/1989                          0.542                                   1989
    Philadelphia             10/11/1995                          0.225                                   1996
   Rhode Island                  N/A                                                                        0
  South Carolina              8/23/1996                          0.358                                   1997
   South Dakota                7/1/1985                          0.504                                   1985
     Tennessee                10/1/1996                          0.251                                   1997
        Texas                  1/1/1996                          1.000                                   1996
         Utah                  5/1/1995                          0.671                                   1995
      Vermont                    1970                                                                    1970
       Virginia                5/5/1995                          0.660                                   1995
    Washington                   1961                                                                    1961
   West Virginia               7/7/1989                          0.488                                   1990
     Wisconsin                11/1/2011                          0.167                                   2012
      Wyoming                 10/1/1994                          0.252                                   1995
                                                             60

So we will replace white spaces with more than 40 consecutive spaces with NA. Let’s also remove the leading white spaces that varies infront of the state names, as DC does not have any and this could cause a problem later. We will also replace any white spaces of 2 consecutive spaces or more , but less than 15 white spaces with “|” so that we can split the data based on this symbol. Thus we will also put these around the NA value that we are using replace the white spaces made of 40+ spaces.

p_62b <-p_62 %>%
  mutate(RTC = str_replace_all(pull(., RTC), "\\s{40,}", "|N/A|")) %>%
  mutate(RTC =str_trim(pull(., RTC), side = "left")) %>%
  mutate(RTC = str_replace_all(pull(., RTC), "\\s{2,15}", "|"))
head(p_62b)

# A tibble: 6 x 1
  RTC                              
  <chr>                            
1 Alabama||1975|N/A|1975           
2 Alaska||10/1/1994||0.252|||1995  
3 Arizona| 7/17/1994||0.460|||1995 
4 Arkansas| 7/27/1995||0.433|||1996
5 California||N/A|N/A|0            
6 Colorado| 5/17/2003||0.627|||2003

Now anytime there is one or more "|" we should have a column break. So now we will split the data by this symbol.

p_62b <-pull(p_62b, RTC) %>%
  str_split( "\\|{1,}") 

head(p_62b)

[[1]]
[1] "Alabama" "1975"    "N/A"     "1975"   

[[2]]
[1] "Alaska"    "10/1/1994" "0.252"     "1995"     

[[3]]
[1] "Arizona"    " 7/17/1994" "0.460"      "1995"      

[[4]]
[1] "Arkansas"   " 7/27/1995" "0.433"      "1996"      

[[5]]
[1] "California" "N/A"        "N/A"        "0"         

[[6]]
[1] "Colorado"   " 5/17/2003" "0.627"      "2003"

Great! Now we want to put our data in tibble format. To do so we need to bind the rows together. We can do so using the base rbind() function. We will use this instead of the bind_rows() function of dplyr because rbind() is less restrictive and allows for columns without names. We will use the base do.call() function, so that this is performed along each character string within the list of p_62b while maintaining the structure. Then we create a tibble out of this. avocado… describe do.call better… maybe do something tidyverse…

p_62 <- as.tibble(do.call(rbind, p_62b))

colnames(p_62) <- c("STATE",
                    "E_Date_RTC",
                    "Frac_Yr_Eff_Yr_Pass",
                    "RTC_Date_SA")

p_62 <- p_62 %>%
  dplyr::select(STATE, RTC_Date_SA) %>%
  rename("RTC_LAW_YEAR"= RTC_Date_SA) %>%
  mutate(RTC_LAW_YEAR = as.numeric(RTC_LAW_YEAR)) %>%
  mutate(RTC_LAW_YEAR = case_when(RTC_LAW_YEAR == 0 ~ Inf,
                              TRUE ~ RTC_LAW_YEAR))

RTC <-p_62
RTC

# A tibble: 52 x 2
   STATE                RTC_LAW_YEAR
   <chr>                       <dbl>
 1 Alabama                      1975
 2 Alaska                       1995
 3 Arizona                      1995
 4 Arkansas                     1996
 5 California                    Inf
 6 Colorado                     2003
 7 Connecticut                  1970
 8 Delaware                      Inf
 9 District of Columbia          Inf
10 Florida                      1988
# … with 42 more rows

avocado why inf?

from Michael

p_62b <-pull(p_62b, RTC) %>%
  str_split( "\\|{1,}") %>% as.data.frame()
  unlist()



p_62b <-p_62 %>%
  mutate(RTC = str_replace_all(pull(., RTC), "\\s{40,}", "|N/A|")) %>%
   mutate(RTC = str_replace_all(pull(., RTC), "\\s{2,15}", "|"))

p_62b %<>%
mutate(value = str_split(pull(., value), "\\|{1}"))

read_csv(p_62b$value)  

p_62 <- p_62 %>%
    apply(1,str_replace_all, "\\s{40,}", "|N/A|") %>%
    str_replace_all("\\s{2,15}", "|") %>%
    as.data.frame()

p_62 <- sapply(p_62$., str_split, "\\|{1,}")

sapply(p_62, nchar)

p_62 <- lapply(p_62, function(x) x[nchar(x) > 0]) 

p_62 <- as.data.frame(do.call(rbind, p_62))

rownames(p_62)

rownames(p_62) <- c()

colnames(p_62) <- c("STATE",
                    "E_Date_RTC",
                    "Frac_Yr_Eff_Yr_Pass",
                    "RTC_Date_SA")
sapply(p_62, class)

p_62 <- p_62 %>%
  dplyr::select(STATE, RTC_Date_SA) %>%
  rename("RTC_LAW_YEAR"=RTC_Date_SA) %>%
  mutate(RTC_LAW_YEAR = as.numeric(RTC_LAW_YEAR)) %>%
  mutate(RTC_LAW_YEAR = case_when(RTC_LAW_YEAR == 0 ~ Inf,
                              TRUE ~ RTC_LAW_YEAR))

sapply(p_62, class)

head(p_62)

Joining Data

Now we will join the data from the different data sets together to create a tibble of data for an analysis that will be similar to the data used by Donohue et al. {target="_blank"} and Lott and Mustard.

First we need to check that our data is indeed ready to be joined. We need to make sure that the column names are the same for each dataset that we intend to combine together.

We will use the compare_df_cols() and compare_df_cols_same() functions of the janitor package, to ensure that the column names are the same and that the column values are the same type so that the tibbles can be joined by row.

If they can be joined by row, then compare_df_cols_same() returns the value TRUE, while compare_df_cols(), provides a description of the columns.

library(janitor)

data_list <-  list(dem_DONOHUE,
                dem_LOTT,
                population_data,
                ue_rate_data,
                poverty_rate_data,
                crime_data,
                ps_data) #police staffing

janitor::compare_df_cols_same(data_list)

[1] TRUE

janitor::compare_df_cols(data_list)

  column_name data_list_1 data_list_2 data_list_3 data_list_4 data_list_5
1       STATE   character   character   character   character   character
2       VALUE     numeric     numeric     numeric     numeric     numeric
3    VARIABLE   character   character   character   character   character
4        YEAR     numeric     numeric     numeric     numeric     numeric
  data_list_6 data_list_7
1   character   character
2     numeric     numeric
3   character   character
4     numeric     numeric

checkstate <- function(x) { x %<>% distinct(STATE) %>% tally() %>% pull(n) }
map(data_list, checkstate)

[[1]]
[1] 51

[[2]]
[1] 51

[[3]]
[1] 51

[[4]]
[1] 51

[[5]]
[1] 51

[[6]]
[1] 51

[[7]]
[1] 51

checkyear <- function(x) { x %<>% distinct(YEAR) %>% tally() %>% pull(n) }
map(data_list, checkyear)

[[1]]
[1] 34

[[2]]
[1] 34

[[3]]
[1] 34

[[4]]
[1] 44

[[5]]
[1] 39

[[6]]
[1] 38

[[7]]
[1] 38

Avocado bind_rows will make na values for the later years beyond 2010 for the datasets that have them… not sure why we are adding these… maybe there is more about that later?

Donohue, et al.

We will now bind the demogrpahic data that we made for the Donohue-like analysis called dem_DONOHUE, as well as all the other datasets that we have wrangled. This is possible because we have the same colnames for each dataset. We will also use the pivot_wider() function of the tidyr package to change the shape of the data. This will make the data have more columns. Each unique value in the column called VARIABLE will be used to make new columns. and the values for each will come from the column called VALUE.

DONOHUE_DF <- bind_rows(dem_DONOHUE,
                        ue_rate_data,
                        poverty_rate_data,
                        crime_data,
                        population_data,
                        ps_data)
head(DONOHUE_DF)

# A tibble: 6 x 4
   YEAR STATE   VARIABLE                    VALUE
  <dbl> <chr>   <chr>                       <dbl>
1  1977 Alabama Black_Male_15_to_19_years  1.55  
2  1977 Alabama Black_Male_20_to_39_years  3.04  
3  1977 Alabama Other_Male_15_to_19_years  0.0178
4  1977 Alabama Other_Male_20_to_39_years  0.0642
5  1977 Alabama White_Male_15_to_19_years  3.58  
6  1977 Alabama White_Male_20_to_39_years 11.1

DONOHUE_DF %<>%
  pivot_wider(names_from = "VARIABLE",
              values_from = "VALUE")

DONOHUE_DF %>%
  slice_sample(n = 10) %>%
  glimpse()

Rows: 10
Columns: 13
$ YEAR                      <dbl> 1995, 2003, 2015, 2000, 1997, 2012, 1988, 1…
$ STATE                     <chr> "California", "Massachusetts", "Oregon", "O…
$ Black_Male_15_to_19_years <dbl> 0.31138464, 0.31299021, NA, 0.37549593, 0.6…
$ Black_Male_20_to_39_years <dbl> 1.36817330, 1.05512361, NA, 1.21101852, 2.1…
$ Other_Male_15_to_19_years <dbl> 0.45350592, 0.25250036, NA, 0.68999657, 0.1…
$ Other_Male_20_to_39_years <dbl> 2.1290345, 1.1601751, NA, 1.9453069, 0.5596…
$ White_Male_15_to_19_years <dbl> 2.691623, 2.930434, NA, 2.974787, 2.889778,…
$ White_Male_20_to_39_years <dbl> 13.58846, 11.63306, NA, 10.89523, 12.14260,…
$ Unemployment_rate         <dbl> 7.9, 5.7, 5.6, 3.0, 4.8, 9.0, 6.0, 5.1, 9.3…
$ Poverty_rate              <dbl> 16.7, 10.3, 11.9, 14.9, 11.2, 22.0, 12.5, 1…
$ Viol_crime_count          <dbl> 305154, 30377, NA, 17177, 102476, 7769, 234…
$ Population                <dbl> 31493525, 6422565, NA, 3454365, 12011509, N…
$ police_per_100k_lag       <dbl> 293.3968, 316.2755, NA, 303.9922, 329.2592,…

We will also add the Right to Carry Law data using the left_join() function of the dplyr package. Which will place the DONOHUE_DF data on the left of the RTC data. Values will be matched by STATE. Then we will create a new variable called RTC_LAW using the mutate() function and the case_when() function of the dplyr package that will have the value TRUE if the current year data is equal to or greater than the year that a more premisive RTC law was adopted, otherwise the value will be FALSE.

head(RTC)

# A tibble: 6 x 2
  STATE      RTC_LAW_YEAR
  <chr>             <dbl>
1 Alabama            1975
2 Alaska             1995
3 Arizona            1995
4 Arkansas           1996
5 California          Inf
6 Colorado           2003

DONOHUE_DF %<>%
  left_join(RTC , by = c("STATE")) %>%
  mutate(RTC_LAW = case_when(YEAR >= RTC_LAW_YEAR ~ TRUE,
                              TRUE ~ FALSE))

DONOHUE_DF %>%
  slice_sample(n = 10) %>%
  glimpse()

Rows: 10
Columns: 15
$ YEAR                      <dbl> 1988, 2015, 1994, 1986, 1984, 2000, 2004, 2…
$ STATE                     <chr> "Iowa", "Maryland", "Michigan", "Alabama", …
$ Black_Male_15_to_19_years <dbl> 0.09059483, NA, 0.60273478, 1.26148927, 0.4…
$ Black_Male_20_to_39_years <dbl> 0.2938914, NA, 2.1038176, 3.6530402, 1.5079…
$ Other_Male_15_to_19_years <dbl> 0.06148022, NA, 0.08476202, 0.03605114, 0.0…
$ Other_Male_20_to_39_years <dbl> 0.2328085, NA, 0.3460699, 0.1415490, 0.1527…
$ White_Male_15_to_19_years <dbl> 3.664647, NA, 2.918864, 2.887824, 3.581117,…
$ White_Male_20_to_39_years <dbl> 14.906461, NA, 12.874229, 12.087804, 14.286…
$ Unemployment_rate         <dbl> 4.5, 5.1, 6.0, 9.7, 9.5, 4.9, 5.1, 4.7, 7.9…
$ Poverty_rate              <dbl> 9.4, 9.6, 14.1, 23.8, 13.5, 17.5, 9.3, 14.8…
$ Viol_crime_count          <dbl> 7279, NA, 72751, 22616, 41430, 13786, 29489…
$ Population                <dbl> 2768370, NA, 9584481, 3991552, 10737767, 18…
$ police_per_100k_lag       <dbl> 205.7167, NA, 272.4300, 260.5753, 216.5348,…
$ RTC_LAW_YEAR              <dbl> 2011, Inf, 2001, 1975, 2004, 2004, Inf, 199…
$ RTC_LAW                   <lgl> FALSE, FALSE, FALSE, TRUE, FALSE, FALSE, FA…

Since we have differing numbers of years for each data set, we can use the drop_na() function of the tidyr package. to remove years that have incomplete data. Thus any row with NA values will be removed.

For example, we can see that for 1977, althouth we have most of the data, we do not have the poverty rate.

DONOHUE_DF %>%
  filter(YEAR == 1977) %>%
  head() %>%
  glimpse()

Rows: 6
Columns: 15
$ YEAR                      <dbl> 1977, 1977, 1977, 1977, 1977, 1977
$ STATE                     <chr> "Alabama", "Alaska", "Arizona", "Arkansas",…
$ Black_Male_15_to_19_years <dbl> 1.5457212, 0.1631338, 0.1804065, 1.0106946,…
$ Black_Male_20_to_39_years <dbl> 3.0379602, 0.9684809, 0.4796284, 1.8185525,…
$ Other_Male_15_to_19_years <dbl> 0.01781857, 1.11902724, 0.40213472, 0.03058…
$ Other_Male_20_to_39_years <dbl> 0.06421558, 2.72594532, 0.89144464, 0.09260…
$ White_Male_15_to_19_years <dbl> 3.578069, 3.828357, 4.391965, 3.879766, 4.1…
$ White_Male_20_to_39_years <dbl> 11.08537, 17.91501, 14.07430, 11.70744, 14.…
$ Unemployment_rate         <dbl> 7.3, 9.9, 8.2, 6.5, 8.3, 6.4
$ Poverty_rate              <dbl> NA, NA, NA, NA, NA, NA
$ Viol_crime_count          <dbl> 15293, 1804, 11347, 6924, 154582, 13407
$ Population                <dbl> 3782571, 397220, 2427296, 2207195, 22350332…
$ police_per_100k_lag       <dbl> 195.1054, 136.9518, 264.2447, 151.5045, 293…
$ RTC_LAW_YEAR              <dbl> 1975, 1995, 1995, 1996, Inf, 2003
$ RTC_LAW                   <lgl> TRUE, FALSE, FALSE, FALSE, FALSE, FALSE

Another example, in 2018 we only have infromation about unemployment rates, poverty rates, and RTC laws.

DONOHUE_DF %>%
  filter(YEAR == 2018) %>%
  head() %>%
  glimpse()

Rows: 6
Columns: 15
$ YEAR                      <dbl> 2018, 2018, 2018, 2018, 2018, 2018
$ STATE                     <chr> "Alabama", "Alaska", "Arizona", "Arkansas",…
$ Black_Male_15_to_19_years <dbl> NA, NA, NA, NA, NA, NA
$ Black_Male_20_to_39_years <dbl> NA, NA, NA, NA, NA, NA
$ Other_Male_15_to_19_years <dbl> NA, NA, NA, NA, NA, NA
$ Other_Male_20_to_39_years <dbl> NA, NA, NA, NA, NA, NA
$ White_Male_15_to_19_years <dbl> NA, NA, NA, NA, NA, NA
$ White_Male_20_to_39_years <dbl> NA, NA, NA, NA, NA, NA
$ Unemployment_rate         <dbl> 3.9, 6.5, 4.7, 3.6, 4.3, 3.2
$ Poverty_rate              <dbl> 16.0, 13.1, 12.8, 15.9, 11.9, 9.1
$ Viol_crime_count          <dbl> NA, NA, NA, NA, NA, NA
$ Population                <dbl> NA, NA, NA, NA, NA, NA
$ police_per_100k_lag       <dbl> NA, NA, NA, NA, NA, NA
$ RTC_LAW_YEAR              <dbl> 1975, 1995, 1995, 1996, Inf, 2003
$ RTC_LAW                   <lgl> TRUE, TRUE, TRUE, TRUE, FALSE, TRUE

DONOHUE_DF %<>%
 drop_na()

head(DONOHUE_DF) %>% 
  glimpse()

Rows: 6
Columns: 15
$ YEAR                      <dbl> 1980, 1980, 1980, 1980, 1980, 1980
$ STATE                     <chr> "Alabama", "Alaska", "Arizona", "Arkansas",…
$ Black_Male_15_to_19_years <dbl> 1.4567383, 0.1670456, 0.1747544, 0.9545139,…
$ Black_Male_20_to_39_years <dbl> 3.3613348, 0.9933775, 0.5267121, 1.9738213,…
$ Other_Male_15_to_19_years <dbl> 0.02128385, 1.12978156, 0.41504620, 0.03849…
$ Other_Male_20_to_39_years <dbl> 0.08608419, 2.96332905, 0.98492602, 0.12425…
$ White_Male_15_to_19_years <dbl> 3.398210, 3.627805, 4.091577, 3.740199, 3.8…
$ White_Male_20_to_39_years <dbl> 11.57164, 18.28852, 14.69238, 12.12513, 14.…
$ Unemployment_rate         <dbl> 8.9, 9.6, 6.6, 7.6, 6.8, 5.8
$ Poverty_rate              <dbl> 21.2, 9.6, 12.8, 21.5, 11.0, 8.6
$ Viol_crime_count          <dbl> 17320, 1919, 17673, 7656, 210290, 15215
$ Population                <dbl> 3899671, 404680, 2735840, 2288809, 23792840…
$ police_per_100k_lag       <dbl> 201.3247, 194.7218, 262.6616, 152.0005, 243…
$ RTC_LAW_YEAR              <dbl> 1975, 1995, 1995, 1996, Inf, 2003
$ RTC_LAW                   <lgl> TRUE, FALSE, FALSE, FALSE, FALSE, FALSE

tail(DONOHUE_DF) %>% 
  glimpse()

Rows: 6
Columns: 15
$ YEAR                      <dbl> 2010, 2010, 2010, 2010, 2010, 2010
$ STATE                     <chr> "Vermont", "Virginia", "Washington", "West …
$ Black_Male_15_to_19_years <dbl> 0.06725669, 0.83162848, 0.15964128, 0.16343…
$ Black_Male_20_to_39_years <dbl> 0.2056042, 2.7300368, 0.6653574, 0.6164599,…
$ Other_Male_15_to_19_years <dbl> 0.1702984, 0.3274050, 0.5979246, 0.1050716,…
$ Other_Male_20_to_39_years <dbl> 0.4754297, 1.3483385, 2.1186016, 0.3126259,…
$ White_Male_15_to_19_years <dbl> 3.531216, 2.338080, 2.755299, 3.050422, 2.9…
$ White_Male_20_to_39_years <dbl> 11.363026, 9.776093, 11.195603, 11.548874, …
$ Unemployment_rate         <dbl> 6.1, 7.1, 10.0, 8.7, 8.7, 6.4
$ Poverty_rate              <dbl> 10.8, 10.7, 11.6, 16.8, 10.1, 9.6
$ Viol_crime_count          <dbl> 820, 17184, 21138, 5586, 14167, 1117
$ Population                <dbl> 625960, 8024617, 6744496, 1853973, 5691047,…
$ police_per_100k_lag       <dbl> 264.2341, 302.9677, 265.1495, 272.0644, 344…
$ RTC_LAW_YEAR              <dbl> 1970, 1995, 1961, 1990, 2012, 1995
$ RTC_LAW                   <lgl> TRUE, TRUE, TRUE, TRUE, FALSE, TRUE

Now we have complete data and the data spans from 1980 to 2010.

DONOHUE_DF %>% distinct(YEAR) %>% pull(YEAR)

 [1] 1980 1981 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994
[16] 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009
[31] 2010

If we include states that had a RTC law adopted before our time span of data, say 1975, then we only have information about crime rates and the other variables of interest after the law was adopted but not before, therefore including these states doesn’t really makes sense. Thus, we will drop the data for these states. We can use the set_diff() function of the dplyr package to see what states are in the population_data that contains all the original 51 states (recall this includes the District of Columbia) but are not in the DONOHUE_DF. The order matters here. If we did it the other way around with population_data listed second, then set_diff would test if there are any states in Donohue_DF that are not in population_data. As there are none this would result in nothing.

baseline_year <- min(DONOHUE_DF$YEAR)
censoring_year <- max(DONOHUE_DF$YEAR)

DONOHUE_DF %<>%
  mutate(TIME_0 = baseline_year,
         TIME_INF = censoring_year) %>%
  filter(RTC_LAW_YEAR > TIME_0)

# DONOHUE_DF %<>% 
#   mutate(STATE = as.factor(STATE))
# 
# DONOHUE_DF %>% 
#   pull(STATE) %>% 
#   levels()

setdiff(distinct(population_data, STATE), 
        distinct(DONOHUE_DF, STATE))

# A tibble: 6 x 1
  STATE        
  <chr>        
1 Alabama      
2 Connecticut  
3 Indiana      
4 New Hampshire
5 Vermont      
6 Washington

We will also calculate a violent crime rate relative to the population in that state at that time, now that we have data for both crime count and population. Will will also calcuate the log value of this rate and the population.

DONOHUE_DF %<>%
  mutate(Viol_crime_rate_1k = (Viol_crime_count*1000)/Population,
         Viol_crime_rate_1k_log = log(Viol_crime_rate_1k),
         Population_log = log(Population))

From michael:

 DONOHUE_DF %>%
   count() %>%
   filter(n != 51) %>%
   print(n=dim(.)[1])

 summary(as.factor(DONOHUE_DF$STATE))

 max(DONOHUE_DF$YEAR) - min(DONOHUE_DF$YEAR) + 1

 DONOHUE_DF <- DONOHUE_DF %>%
   mutate(STATE = fct_collapse(STATE, "District of Columbia"=c("District of Columbia","D.C.")))

 summary(as.factor(DONOHUE_DF$STATE))
  
length(levels(DONOHUE_DF$STATE))

DONOHUE_DF <- DONOHUE_DF %>%
  group_by(STATE, YEAR) %>%
  summarise_all(~na.omit(unique(.))) %>%
  ungroup() # This identifies unique observations, coalesces rows according to the grouping variable(s), and gets rid of of units that have incomplete data. This gives returns a dataframe with the most complete information.

summary(as.factor(DONOHUE_DF$STATE)) 

baseline_year <- min(DONOHUE_DF$YEAR)
censoring_year <- max(DONOHUE_DF$YEAR)

# Need to fix this to ensure severe bias is not introduced by prevalent "cases"

DONOHUE_DF <- DONOHUE_DF %>%
  mutate(TIME_0 = baseline_year,
         TIME_INF = censoring_year) %>%
  filter(RTC_LAW_YEAR > TIME_0)

DONOHUE_DF <- DONOHUE_DF %>%
  mutate(Viol_crime_rate_1k = (Viol_crime_count*1000)/Population,
         Viol_crime_rate_1k_log = log(Viol_crime_rate_1k),
         Population_log = log(Population))

summary(droplevels(as.factor(DONOHUE_DF$STATE)))

length(summary(droplevels(as.factor(DONOHUE_DF$STATE))))

Lott and Mustard

We will now bind the demogrpahic data that we made for the Lott-like analysis called dem_Lott, as well as all the other datasets that we have wrangled just as we did for the Donohue-like analysis. Again, this is possible because we have the same colnames for each dataset.

LOTT_DF <- bind_rows(dem_LOTT,
                     ue_rate_data,
                     poverty_rate_data,
                     crime_data,
                     population_data,
                     ps_data) %>%
  pivot_wider(names_from = "VARIABLE",
              values_from = "VALUE") %>%
  left_join(RTC , by = c("STATE")) %>%
  mutate(RTC_LAW = case_when(YEAR >= RTC_LAW_YEAR ~ TRUE,
                              TRUE ~ FALSE)) %>%
   drop_na()


baseline_year <- min(LOTT_DF$YEAR)
censoring_year <- max(LOTT_DF$YEAR)

LOTT_DF %<>%
  mutate(TIME_0 = baseline_year,
         TIME_INF = censoring_year) %>%
  filter(RTC_LAW_YEAR > TIME_0)

setdiff(distinct(population_data, STATE), 
        distinct(LOTT_DF, STATE))

# A tibble: 6 x 1
  STATE        
  <chr>        
1 Alabama      
2 Connecticut  
3 Indiana      
4 New Hampshire
5 Vermont      
6 Washington

LOTT_DF %<>%
  mutate(Viol_crime_rate_1k = (Viol_crime_count*1000)/Population,
         Viol_crime_rate_1k_log = log(Viol_crime_rate_1k),
         Population_log = log(Population))

Let’s see how the data compares:

We will check the dimensions of each using the base dim() function

dim(LOTT_DF)

[1] 1395   50

dim(DONOHUE_DF)

[1] 1395   20

As expected the Lott_DF is 30 columns larger, due to the 30 additional demographic variables. We can check those now as well.

LOTT_DF %>%
   colnames()

 [1] "YEAR"                           "STATE"                         
 [3] "Black_Female_10_to_19_years"    "Black_Female_20_to_29_years"   
 [5] "Black_Female_30_to_39_years"    "Black_Female_40_to_49_years"   
 [7] "Black_Female_50_to_64_years"    "Black_Female_65_years_and_over"
 [9] "Black_Male_10_to_19_years"      "Black_Male_20_to_29_years"     
[11] "Black_Male_30_to_39_years"      "Black_Male_40_to_49_years"     
[13] "Black_Male_50_to_64_years"      "Black_Male_65_years_and_over"  
[15] "Other_Female_10_to_19_years"    "Other_Female_20_to_29_years"   
[17] "Other_Female_30_to_39_years"    "Other_Female_40_to_49_years"   
[19] "Other_Female_50_to_64_years"    "Other_Female_65_years_and_over"
[21] "Other_Male_10_to_19_years"      "Other_Male_20_to_29_years"     
[23] "Other_Male_30_to_39_years"      "Other_Male_40_to_49_years"     
[25] "Other_Male_50_to_64_years"      "Other_Male_65_years_and_over"  
[27] "White_Female_10_to_19_years"    "White_Female_20_to_29_years"   
[29] "White_Female_30_to_39_years"    "White_Female_40_to_49_years"   
[31] "White_Female_50_to_64_years"    "White_Female_65_years_and_over"
[33] "White_Male_10_to_19_years"      "White_Male_20_to_29_years"     
[35] "White_Male_30_to_39_years"      "White_Male_40_to_49_years"     
[37] "White_Male_50_to_64_years"      "White_Male_65_years_and_over"  
[39] "Unemployment_rate"              "Poverty_rate"                  
[41] "Viol_crime_count"               "Population"                    
[43] "police_per_100k_lag"            "RTC_LAW_YEAR"                  
[45] "RTC_LAW"                        "TIME_0"                        
[47] "TIME_INF"                       "Viol_crime_rate_1k"            
[49] "Viol_crime_rate_1k_log"         "Population_log"

DONOHUE_DF %>%
   colnames()

 [1] "YEAR"                      "STATE"                    
 [3] "Black_Male_15_to_19_years" "Black_Male_20_to_39_years"
 [5] "Other_Male_15_to_19_years" "Other_Male_20_to_39_years"
 [7] "White_Male_15_to_19_years" "White_Male_20_to_39_years"
 [9] "Unemployment_rate"         "Poverty_rate"             
[11] "Viol_crime_count"          "Population"               
[13] "police_per_100k_lag"       "RTC_LAW_YEAR"             
[15] "RTC_LAW"                   "TIME_0"                   
[17] "TIME_INF"                  "Viol_crime_rate_1k"       
[19] "Viol_crime_rate_1k_log"    "Population_log"

Lastly, we will check that the YEAR values are the same. We can use the setequal() function of the dplyr package to see if the values are the same.

setequal(DONOHUE_DF %>% distinct(YEAR),
          LOTT_DF %>% distinct(YEAR))

[1] TRUE

Looks as expected! we have

from Michael:

LOTT_DF %>%
  group_by(YEAR) %>%
  tally() %>%
  filter(n != 51) %>%
  print(n=dim(.)[1])

summary(as.factor(LOTT_DF$STATE))

max(LOTT_DF$YEAR) - min(LOTT_DF$YEAR) + 1

LOTT_DF <- LOTT_DF %>%
  mutate(STATE = fct_collapse(STATE, "District of Columbia" = c("District of Columbia","D.C.")))

summary(as.factor(LOTT_DF$STATE))
  
length(levels(LOTT_DF$STATE))

LOTT_DF <- LOTT_DF %>%
  group_by(STATE, YEAR) %>%
  summarise_all(~na.omit(unique(.))) %>%
  ungroup() # This identifies unique observations, coalesces rows according to the grouping variable(s), and gets rid of of units that have incomplete data. This gives returns a dataframe with the most complete information.

summary(as.factor(LOTT_DF$STATE)) 

baseline_year <- min(LOTT_DF$YEAR)
censoring_year <- max(LOTT_DF$YEAR)

# Need to fix this to ensure severe bias is not introduced by prevalent "cases"

LOTT_DF <- LOTT_DF %>%
  mutate(TIME_0 = baseline_year,
         TIME_INF = censoring_year) %>%
  filter(RTC_LAW_YEAR > TIME_0)

LOTT_DF <- LOTT_DF %>%
  mutate(Viol_crime_rate_1k = (Viol_crime_count*1000)/Population,
         Viol_crime_rate_1k_log = log(Viol_crime_rate_1k),
         Population_log = log(Population))

summary(droplevels(as.factor(LOTT_DF$STATE)))

length(summary(droplevels(as.factor(LOTT_DF$STATE))))

Data Exploration

Let’s do some quick visualizations to get a sense of our outcome of interest, the violent crime data.

First we will plot the rate of violent crime over time to get a sense of the general trend.

To do so we need to summarise the data for each year across all of the states. Thus we will use the group_by() function and the summarise() functions to calculate an overall sum of violent crime relative to the population for each year.

Then we will use the ggplot2 package to plot the data. The first step in creating a plot with this package is to use the ggplot() function and the aes() argument to specify what data should be plotted on the x-axis and what data should be plotted in on the y-axis. Then we select what type of plot we would like to make using one of the geom_*() functions. Please see this case study for more details.

We can use the scale_x_continuous() and scale_y_continuous() functions to modify the axis labels.

The labs() function can be used to add labels to the plot, while the theme() function allows for manipulation of the detials of the labels, like size and angle.

All of these functions are part of the ggplot2 package.

 DONOHUE_DF %>%
  group_by(YEAR) %>%
  summarise(Viol_crime_count = sum(Viol_crime_count),
                  Population = sum(Population),
                    .groups = "drop") %>%
  mutate(Viol_crime_rate_100k_log = log((Viol_crime_count*100000)/Population)) %>%
  ggplot(aes(x = YEAR, y = Viol_crime_rate_100k_log)) +
  geom_line() +
  scale_x_continuous(breaks = seq(1980, 2010, by = 1),
                     limits = c(1980, 2010),
                     labels = c(seq(1980, 2010, by = 1))) +
  scale_y_continuous(breaks = seq(5.75, 6.75, by = 0.25),
                     limits = c(5.75, 6.75)) +
  labs(title = "Crime rates fluctuate over time",
       x = "Year",
       y = "ln(violent crimes per 100,000 people)") +
  theme_minimal() + 
  theme(axis.text.x = element_text(angle = 90))

Interesting! It appears that there was an overall national peak in violent crime in the early 1990s that has since then declined.

Now let’s take a look at each state.

We will use the ggrepel package to add text to the plot using the geom_text_repel() function. This is especially useful when there is alot of text, as this function reduces the overlap of text labels. Again see this case study for more details on how to add labels to elements of plots.

DONOHUE_DF %>%
  mutate(Viol_crime_rate_100k_log = log((Viol_crime_count*100000)/Population)) %>%
  ggplot(aes(x = YEAR, y = Viol_crime_rate_100k_log, color = STATE)) +
  geom_point(size = 0.5) +
  geom_line(aes(group=STATE),
            size = 0.5,
            show.legend = FALSE) +
  geom_text_repel(data = DONOHUE_DF %>%
              mutate(Viol_crime_rate_100k_log = log((Viol_crime_count*100000)/Population)) %>%
              filter(YEAR == last(YEAR)),
            aes(label = STATE,
                x = YEAR,
                y = Viol_crime_rate_100k_log),
            size = 3,
            alpha = 1,
            nudge_x = 10,
            direction = "y",
            hjust = 1,
            vjust = 1,
            segment.size = 0.25,
            segment.alpha = 0.25,
            force = 1,
            max.iter = 9999) +
  guides(color = FALSE) +
  scale_x_continuous(breaks = seq(1980, 2015, by = 1),
                     limits = c(1980, 2015),
                     labels = c(seq(1980, 2010, by = 1), rep("", 5))) +
  scale_y_continuous(breaks = seq(3.5, 8.5, by = 0.5),
                     limits = c(3.5, 8.5)) +
  labs(title = "States have different levels of crime",
       x = "Year",
       y = "ln(violent crimes per 100,000 people)") +
  theme_minimal() +
  theme(axis.text.x = element_text(angle = 90))

Looks like the crime rages vary quite a bit from one state to another. Some states show increased crime over time while others show decreased crime.

Now let’s take a closer look at some of our other variables.

We can also use the vis_miss() function of the naniar package to confirm that there are no missing values.

DONOHUE_DF %>%
  naniar::vis_miss()

Looks like no missing data!

LOTT_DF %>%
  naniar::vis_miss()

Same for the LOTT_DF.

We can use the skim() of the skimr package to get a better sense of the data. This also shows missingingness, as well as standard deviations, spread, and means for our data. Also notice that there is a histogram of each variable.

skimr::skim(DONOHUE_DF)

Data summary
Name	DONOHUE_DF
Number of rows	1395
Number of columns	20
_______________________
Column type frequency:
character	1
logical	1
numeric	18
________________________
Group variables	None

Variable type: character

skim_variable	n_missing	complete_rate	min	max	empty	n_unique	whitespace
STATE	0	1	4	20	0	45	0

Variable type: logical

skim_variable	n_missing	complete_rate	mean	count
RTC_LAW	0	1	0.37	FAL: 883, TRU: 512

Variable type: numeric

skim_variable	complete_rate	mean	sd	p0	p25	p50	p75	p100	hist
YEAR	1	1995.00	8.95	1980.00	1987.00	1995.00	2003.00	2010.00	▇▇▇▇▇
Black_Male_15_to_19_years	1	0.52	0.51	0.02	0.13	0.35	0.73	3.46	▇▂▁▁▁
Black_Male_20_to_39_years	1	1.73	1.76	0.07	0.50	1.17	2.30	11.33	▇▂▁▁▁
Other_Male_15_to_19_years	1	0.26	0.40	0.01	0.08	0.14	0.28	2.90	▇▁▁▁▁
Other_Male_20_to_39_years	1	0.92	1.40	0.07	0.31	0.55	0.99	9.90	▇▁▁▁▁
White_Male_15_to_19_years	1	3.09	0.72	0.55	2.69	3.14	3.54	4.99	▁▁▇▇▁
White_Male_20_to_39_years	1	12.55	2.29	4.41	11.18	12.65	14.15	18.44	▁▂▇▇▂
Unemployment_rate	1	6.03	2.10	2.30	4.50	5.60	7.20	17.80	▇▇▂▁▁
Poverty_rate	1	13.34	3.84	5.70	10.40	12.70	15.50	27.20	▃▇▅▁▁
Viol_crime_count	1	31760.77	46494.46	322.00	5107.50	14412.00	38782.50	345624.00	▇▁▁▁▁
Population	1	5446810.81	6070687.33	404680.00	1363737.50	3504892.00	6411701.00	37349363.00	▇▂▁▁▁
police_per_100k_lag	1	316.57	115.59	83.76	248.53	301.00	358.31	1021.14	▅▇▁▁▁
RTC_LAW_YEAR	1	Inf	NaN	1985.00	1995.00	1997.00	2011.00	Inf	▇▇▂▅▂
TIME_0	1	1980.00	0.00	1980.00	1980.00	1980.00	1980.00	1980.00	▁▁▇▁▁
TIME_INF	1	2010.00	0.00	2010.00	2010.00	2010.00	2010.00	2010.00	▁▁▇▁▁
Viol_crime_rate_1k	1	5.05	3.19	0.48	2.85	4.54	6.44	29.30	▇▃▁▁▁
Viol_crime_rate_1k_log	1	1.45	0.60	-0.74	1.05	1.51	1.86	3.38	▁▂▇▅▁
Population_log	1	14.99	1.05	12.91	14.13	15.07	15.67	17.44	▃▅▇▅▂

skimr::skim(LOTT_DF)

Data summary
Name	LOTT_DF
Number of rows	1395
Number of columns	50
_______________________
Column type frequency:
character	1
logical	1
numeric	48
________________________
Group variables	None

Variable type: character

skim_variable	n_missing	complete_rate	min	max	empty	n_unique	whitespace
STATE	0	1	4	20	0	45	0

Variable type: logical

skim_variable	n_missing	complete_rate	mean	count
RTC_LAW	0	1	0.37	FAL: 883, TRU: 512

Variable type: numeric

skim_variable	complete_rate	mean	sd	p0	p25	p50	p75	p100	hist
YEAR	1	1995.00	8.95	1980.00	1987.00	1995.00	2003.00	2010.00	▇▇▇▇▇
Black_Female_10_to_19_years	1	1.00	1.02	0.02	0.23	0.63	1.44	6.53	▇▂▁▁▁
Black_Female_20_to_29_years	1	0.99	1.09	0.02	0.23	0.60	1.36	7.73	▇▂▁▁▁
Black_Female_30_to_39_years	1	0.91	1.00	0.01	0.19	0.57	1.27	6.11	▇▂▁▁▁
Black_Female_40_to_49_years	1	0.75	0.86	0.01	0.13	0.48	1.09	5.45	▇▂▁▁▁
Black_Female_50_to_64_years	1	0.76	0.96	0.00	0.12	0.44	1.06	6.10	▇▂▁▁▁
Black_Female_65_years_and_over	1	0.60	0.85	0.00	0.07	0.34	0.81	6.12	▇▁▁▁▁
Black_Male_10_to_19_years	1	1.02	1.01	0.03	0.26	0.67	1.46	6.32	▇▂▁▁▁
Black_Male_20_to_29_years	1	0.93	0.93	0.04	0.29	0.65	1.24	6.57	▇▂▁▁▁
Black_Male_30_to_39_years	1	0.81	0.84	0.02	0.23	0.54	1.08	5.37	▇▂▁▁▁
Black_Male_40_to_49_years	1	0.65	0.72	0.01	0.15	0.43	0.92	4.45	▇▂▁▁▁
Black_Male_50_to_64_years	1	0.62	0.76	0.00	0.13	0.38	0.86	4.79	▇▂▁▁▁
Black_Male_65_years_and_over	1	0.38	0.51	0.00	0.05	0.24	0.51	3.56	▇▁▁▁▁
Other_Female_10_to_19_years	1	0.51	0.77	0.03	0.15	0.27	0.55	5.33	▇▁▁▁▁
Other_Female_20_to_29_years	1	0.49	0.70	0.04	0.17	0.30	0.55	5.55	▇▁▁▁▁
Other_Female_30_to_39_years	1	0.47	0.74	0.04	0.16	0.28	0.51	5.36	▇▁▁▁▁
Other_Female_40_to_49_years	1	0.38	0.69	0.02	0.11	0.21	0.38	5.46	▇▁▁▁▁
Other_Female_50_to_64_years	1	0.38	0.83	0.02	0.09	0.18	0.35	7.10	▇▁▁▁▁
Other_Female_65_years_and_over	1	0.24	0.72	0.01	0.05	0.09	0.18	6.20	▇▁▁▁▁
Other_Male_10_to_19_years	1	0.52	0.80	0.03	0.15	0.28	0.56	5.58	▇▁▁▁▁
Other_Male_20_to_29_years	1	0.48	0.70	0.03	0.17	0.29	0.53	5.33	▇▁▁▁▁
Other_Male_30_to_39_years	1	0.44	0.71	0.03	0.14	0.26	0.47	5.06	▇▁▁▁▁
Other_Male_40_to_49_years	1	0.35	0.65	0.02	0.09	0.19	0.34	5.13	▇▁▁▁▁
Other_Male_50_to_64_years	1	0.33	0.73	0.01	0.08	0.15	0.29	6.50	▇▁▁▁▁
Other_Male_65_years_and_over	1	0.19	0.58	0.01	0.03	0.07	0.14	4.51	▇▁▁▁▁
White_Female_10_to_19_years	1	5.72	1.38	0.94	5.01	5.82	6.61	9.45	▁▁▇▆▁
White_Female_20_to_29_years	1	6.09	1.36	1.59	5.23	5.92	6.93	9.66	▁▂▇▅▂
White_Female_30_to_39_years	1	6.17	1.22	1.53	5.46	6.28	7.02	8.95	▁▁▅▇▂
White_Female_40_to_49_years	1	5.58	1.23	1.20	4.85	5.68	6.41	8.33	▁▁▇▇▃
White_Female_50_to_64_years	1	6.56	1.45	1.72	6.01	6.57	7.34	11.40	▁▂▇▂▁
White_Female_65_years_and_over	1	6.38	1.70	1.05	5.37	6.62	7.51	9.90	▁▁▆▇▂
White_Male_10_to_19_years	1	6.04	1.43	1.02	5.30	6.14	6.95	9.74	▁▁▇▇▁
White_Male_20_to_29_years	1	6.28	1.33	2.41	5.43	6.12	7.14	10.84	▁▆▇▃▁
White_Male_30_to_39_years	1	6.27	1.19	1.93	5.59	6.33	7.06	9.67	▁▂▇▆▁
White_Male_40_to_49_years	1	5.59	1.22	1.35	4.79	5.67	6.43	8.39	▁▁▇▇▂
White_Male_50_to_64_years	1	6.26	1.40	1.78	5.64	6.19	6.94	10.93	▁▂▇▂▁
White_Male_65_years_and_over	1	4.56	1.19	1.02	3.80	4.78	5.34	7.51	▁▂▇▇▁
Unemployment_rate	1	6.03	2.10	2.30	4.50	5.60	7.20	17.80	▇▇▂▁▁
Poverty_rate	1	13.34	3.84	5.70	10.40	12.70	15.50	27.20	▃▇▅▁▁
Viol_crime_count	1	31760.77	46494.46	322.00	5107.50	14412.00	38782.50	345624.00	▇▁▁▁▁
Population	1	5446810.81	6070687.33	404680.00	1363737.50	3504892.00	6411701.00	37349363.00	▇▂▁▁▁
police_per_100k_lag	1	316.57	115.59	83.76	248.53	301.00	358.31	1021.14	▅▇▁▁▁
RTC_LAW_YEAR	1	Inf	NaN	1985.00	1995.00	1997.00	2011.00	Inf	▇▇▂▅▂
TIME_0	1	1980.00	0.00	1980.00	1980.00	1980.00	1980.00	1980.00	▁▁▇▁▁
TIME_INF	1	2010.00	0.00	2010.00	2010.00	2010.00	2010.00	2010.00	▁▁▇▁▁
Viol_crime_rate_1k	1	5.05	3.19	0.48	2.85	4.54	6.44	29.30	▇▃▁▁▁
Viol_crime_rate_1k_log	1	1.45	0.60	-0.74	1.05	1.51	1.86	3.38	▁▂▇▅▁
Population_log	1	14.99	1.05	12.91	14.13	15.07	15.67	17.44	▃▅▇▅▂

Data Analysis

Donohue, et al.

OK! We are now ready to start analyzing our data!.

We have what is called panel data . This is a special type of longitundinal data. Longitudinal data are data measurments taken over time. Panel data are data repeatidly measured for for multiple panel members or individuals over time. This is in contrast with time series data, which measures one individual over time and cross sectional data, which measures multiple individuals at one point in time. In otherwords, panel data is a combination of both, in this case we measure multiple individuals over multiple time periods. In our case, we have measurements of violent crime and other variables for each state over many years. Therefore we are using measurements about the same states over time.

In a panel analysis there are \(N\) individual panel members and \(T\) time points.

There are two types of panels:
1. Balanced - At each time point (\(T\)), there are data points for each individual(\(N\)).

Time Points (\(T\))	Individuals (\(N\))
1977	Navada
1977	Alabama
1977	Kansas
1978	Nevada
1978	Alabama
1978	Kansas
1979	Nevada
1979	Alabama
1979	Kansas

Unbalanced - There may be data points missing for some inidividuals (\(N\)) at some time points (\(T\)).

Time Points (\(T\))	Individuals (\(N\))
1977	Navada
1977	Alabama
1978	Nevada
1978	Alabama
1979	Nevada
1979	Alabama
1979	Kansas

Overall in a a balanced panel, we have \(n\) observations, where \(n = N*T\).

In an unbalanced panel, the number of observations is less than \(N*T\).

In our case we have:
\(N\) = 45 states (recall that we removed those who had adopted a RTC law before 1980)
\(T\) = 31 years (1980 - 2010)

In every year we have measurements for each state (as we just saw above), thus our panel is balanced.

So, our total observations \(n = 45*31\), thus \(n\) = 1395.

We will be performing a panel linear regression model analysis.

In such an analysis we will model our data according to this generic model:

\[Y_{it} = a + B'X_{it} + u_{it},\\ u_{it}=\mu _{i}+v_{it}\] Where \(i\) is the individual dimension (in our case individual states) and \(t\) is the time dimension.

Some independent variables or regressors \(X_{it}\) will vary across individuals and time, while others will be fixed across the time of the study (or don’t change over time), while others still will be fixed across individuals but vary across time periods.

\(\mu _{i}\) are individual effects that are time independent (aka. fixed over time).

\(v_{it}\) are random effects that vary with time

There are three general subtypes of panel regression analysis.

Overall, they assume that the different individuals are independent, however the same data for the same individual may be correlated across time.

The main difference between the three subtypes are the assumptions about unobserved differences between individuals.

independently pooled panels - assumes that there are no individual effects that are independent of time and also no effect of time on all the individuals. In otherwords, the independent variables are not correlated with any error term. This is essentially an ordinary least squares linear regression. This type of panel regression makes the most assumptions and is therefore typically not used for panel data.
fixed effects - assumes that there are unknown or unobserved unique aspects about the individuals or heterogeneity among indivudals \(a_i\) that are not explained by the independent variables but influence the outcome variable of interest. They do not vary with time or in otherwords are fixed over time but may be correlated with independent variables \(X_{it}\).

In this case the intercept can be different for each indivudual \({a_i}\), but the slope is the same across all the individuals.

These individual \(a_i\) effects can be correlated with the independent variables \(X\).

\[Y_{it} = a_i + B'X_{it} + u_{it},\\ u_{it}=\mu _{i}+v_{it}\] This type of panel regression makes the least assumptions.

random effects - assumes that there are unknown or unobserved unique qualities about the individuals that influences the outcome variable of interest that are not correlated with the independent variables.

Thus, the random effects model actually makes more assumptions than the fixed effect model.

\[Y_{it} = B'X_{it} + (a_i + e_{it})}\] So each indivual has the sampe slope and the same overall error term (a_i + e_{it}).

See here and here for more information about these different models.

We will be performing a fixed effect panel regression analysis, as we do in fact think that some of the unobserved qualities about the different states that may be correlated with some of our independent variables. For example, the level of economic opportunity might be an unobserved feature about the states that influences violent crime rate and would be possibly correlated with poverty rate and unemployment.

avocado:We assume that data for the same individual may be correlated, but we assume that the different indivudals are independent.

avocado from Michael:Some code taken from http://karthur.org/2019/implementing-fixed-effects-panel-models-in-r.html

To perform our analysis we will be using the plm package. This stands for Panel Linear Model.

We need to use a special type of data to use this package, called a pdata.frame which is short for panel data frame. This allows us to specify that we are using panel data and what the panel structure looks like.

We need to indicate variable should be used to identify the individuals in our panel, and what variable should be used to identify the time periods in our panel. In our case the STATE variable identifies the individuals and the YEAR variable identifies the time periods.

We can specify this structure using the pdata.frame() function of the plm package, by using the index argument, where the individual variale is specified first followed by the time variable, like so: `index=c(“Individual_Variable_NAME”, “Time_Period_Variable_NAME”).

d_panel_DONOHUE <- pdata.frame(DONOHUE_DF, index=c("STATE", "YEAR"))

class(d_panel_DONOHUE)

[1] "pdata.frame" "data.frame"

slice_head(d_panel_DONOHUE, n = 3)

            YEAR  STATE Black_Male_15_to_19_years Black_Male_20_to_39_years
Alaska-1980 1980 Alaska                 0.1670456                 0.9933775
Alaska-1981 1981 Alaska                 0.1732299                 1.0028219
Alaska-1982 1982 Alaska                 0.1737069                 1.0204445
            Other_Male_15_to_19_years Other_Male_20_to_39_years
Alaska-1980                  1.129782                  2.963329
Alaska-1981                  1.124441                  2.974775
Alaska-1982                  1.069821                  3.015071
            White_Male_15_to_19_years White_Male_20_to_39_years
Alaska-1980                  3.627805                  18.28852
Alaska-1981                  3.558261                  18.12821
Alaska-1982                  3.391844                  18.10666
            Unemployment_rate Poverty_rate Viol_crime_count Population
Alaska-1980               9.6          9.6             1919     404680
Alaska-1981               9.4          9.0             2537     418519
Alaska-1982               9.9         10.6             2732     449608
            police_per_100k_lag RTC_LAW_YEAR RTC_LAW TIME_0 TIME_INF
Alaska-1980            194.7218         1995   FALSE   1980     2010
Alaska-1981            200.2299         1995   FALSE   1980     2010
Alaska-1982            191.0553         1995   FALSE   1980     2010
            Viol_crime_rate_1k Viol_crime_rate_1k_log Population_log
Alaska-1980           4.742018               1.556463       12.91085
Alaska-1981           6.061851               1.802015       12.94448
Alaska-1982           6.076404               1.804413       13.01613

Indeed we have now created a pdata.frame object and we can see that the row names show the individual states and time period years.

OK, now we are ready to run our panel linear model on our panel data frame.

To do so we will use the plm() function and we will specify the formula for our model, where the dependent variable Viol_crime_rate_1k_log will be on the left of our ~ sign and all of the independent variables will be listed on the right with + signs in between each.

We also need to specify what type of effect we would like to model and what type of model we would like to use.

There are three main options for the effect argument: 1) individual - model for the effect of indivudal identity 2) time - model for the effect of time 3) twoways - meaning modeling for the effect of both individual identity and time

There are four main options for the model argument:
1) pooling - standard pooled ordinary least squares regression model
2) within - fixed effects model (variation between individuals is ignored, model compares individuals to themselves at different periods of time)
3) between - fixed effects model (variation within individuals from one time point to another is ignored, model compares different individuals at each point of time)
4) random - random effects (each state has a different intercept but force it to follow a normal distribution - requires more assumptions)

Typically it is best to think about what you are trying to evaluate with your data in trying to choose how to model your data. However, there are also some tests that can help to assess this which we will briefly cover.

We are interested in how violence in each state varied over time, thus we are interested in within STATEvariation, so we will perform our plm with the model = within argument to perform this particular type of fixed effects model.

We also speculate that there is an effect of individual STATE identity and time on violent crime rate. In otherwords, we expect some states to have high rates of crime, and others to have low rates of crime. We also expect crime to change over time.

If we were to perform this type of analysis we would use the effect = "twoways" argument in our plm() function like so:

DONOHUE_OUTPUT <- plm(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag,
                        effect = "twoways",
                        model = "within",
                        data = d_panel_DONOHUE)

To see the results we can use the base summary() function. We can view this output in tidy format using the tidy() function of the broom package.

avocado I think the analysis variable is a lable for plots

summary(DONOHUE_OUTPUT)

Twoways effects Within Model

Call:
plm(formula = Viol_crime_rate_1k_log ~ RTC_LAW + White_Male_15_to_19_years + 
    White_Male_20_to_39_years + Black_Male_15_to_19_years + Black_Male_20_to_39_years + 
    Other_Male_15_to_19_years + Other_Male_20_to_39_years + Unemployment_rate + 
    Poverty_rate + Population_log + police_per_100k_lag, data = d_panel_DONOHUE, 
    effect = "twoways", model = "within")

Balanced Panel: n = 45, T = 31, N = 1395

Residuals:
       Min.     1st Qu.      Median     3rd Qu.        Max. 
-0.57957437 -0.08942194 -0.00090654  0.08673054  1.11216999 

Coefficients:
                             Estimate  Std. Error t-value  Pr(>|t|)    
RTC_LAWTRUE                0.01796779  0.01663911  1.0799 0.2804066    
White_Male_15_to_19_years -0.00091825  0.02724210 -0.0337 0.9731160    
White_Male_20_to_39_years  0.03466473  0.00972839  3.5633 0.0003794 ***
Black_Male_15_to_19_years -0.05673593  0.05746052 -0.9874 0.3236341    
Black_Male_20_to_39_years  0.12605439  0.01931450  6.5264 9.607e-11 ***
Other_Male_15_to_19_years  0.69201638  0.11322394  6.1119 1.297e-09 ***
Other_Male_20_to_39_years -0.30276797  0.03811855 -7.9428 4.226e-15 ***
Unemployment_rate         -0.01685806  0.00489952 -3.4408 0.0005984 ***
Poverty_rate              -0.00780235  0.00295720 -2.6384 0.0084280 ** 
Population_log            -0.17991653  0.06041773 -2.9779 0.0029559 ** 
police_per_100k_lag        0.00060391  0.00013689  4.4115 1.111e-05 ***
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Total Sum of Squares:    43.211
Residual Sum of Squares: 36.716
R-Squared:      0.15031
Adj. R-Squared: 0.095138
F-statistic: 21.0514 on 11 and 1309 DF, p-value: < 2.22e-16

DONOHUE_OUTPUT_TIDY <- tidy(DONOHUE_OUTPUT, conf.int = 0.95)

DONOHUE_OUTPUT_TIDY

# A tibble: 11 x 7
   term                 estimate std.error statistic  p.value conf.low conf.high
   <chr>                   <dbl>     <dbl>     <dbl>    <dbl>    <dbl>     <dbl>
 1 RTC_LAWTRUE          0.0180    0.0166      1.08   2.80e- 1 -1.46e-2  0.0506  
 2 White_Male_15_to_1… -0.000918  0.0272     -0.0337 9.73e- 1 -5.43e-2  0.0525  
 3 White_Male_20_to_3…  0.0347    0.00973     3.56   3.79e- 4  1.56e-2  0.0537  
 4 Black_Male_15_to_1… -0.0567    0.0575     -0.987  3.24e- 1 -1.69e-1  0.0559  
 5 Black_Male_20_to_3…  0.126     0.0193      6.53   9.61e-11  8.82e-2  0.164   
 6 Other_Male_15_to_1…  0.692     0.113       6.11   1.30e- 9  4.70e-1  0.914   
 7 Other_Male_20_to_3… -0.303     0.0381     -7.94   4.23e-15 -3.77e-1 -0.228   
 8 Unemployment_rate   -0.0169    0.00490    -3.44   5.98e- 4 -2.65e-2 -0.00726 
 9 Poverty_rate        -0.00780   0.00296    -2.64   8.43e- 3 -1.36e-2 -0.00201 
10 Population_log      -0.180     0.0604     -2.98   2.96e- 3 -2.98e-1 -0.0615  
11 police_per_100k_lag  0.000604  0.000137    4.41   1.11e- 5  3.36e-4  0.000872

DONOHUE_OUTPUT_TIDY$Analysis <- "Analysis 1"

We will now perform a test to determine if we could have simply used a pooled model. This test evaluates if the coefficients (including the intercepts) are equal. To perform this test we will use the pooltest() function of the plm package to compare the pooled model to the fixed effect within model.

pooltest(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag, 
         data = d_panel_DONOHUE, 
         model = "within")


    F statistic

data:  Viol_crime_rate_1k_log ~ RTC_LAW + White_Male_15_to_19_years +  ...
F = 15.299, df1 = 484, df2 = 855, p-value < 2.2e-16
alternative hypothesis: unstability

The p-value is less than a significance threshold of .05, thus we reject the null that our coeffients are all equal. Thus the within fixed effects model fit the data better.

We can also perform a test to evaluate if there is indeed an individual effect and a time effect in our model.

We can use the plmtest() function of the plm package. This performs a Lagrange Multiplier Test. To do so, we need to get the output for a simple pooled model.

DONOHUE_pool_model <-plm(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag,
                        model = "pooling",
                        data=d_panel_DONOHUE)

plmtest(DONOHUE_pool_model, effect = c("twoways"))


    Lagrange Multiplier Test - two-ways effects (Honda) for balanced
    panels

data:  Viol_crime_rate_1k_log ~ RTC_LAW + White_Male_15_to_19_years +  ...
normal = 72.56, p-value < 2.2e-16
alternative hypothesis: significant effects

Again, the p-value is much smaller than the significance threshold of < 0.05. Therefore we reject the null that there are no effects, and we can feel confident with proceeding with a twoway effect model.

There is one more test that we could perform. To test if using a random effect model would be more appropriate compared to the fixed effect model, one could use the Hausmen test for this (also called the Durbin-Wu-Hausman test). This can be implemented using the phtest() function of the plm package.

DONOHUE_random_model <-  plm(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag,
                      effect = "twoways",
                      model = "random",
                      data=d_panel_DONOHUE)

DONOHUE_within_model <-  plm(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag,
                       effect = "twoways",
                       model = "within",
                       data=d_panel_DONOHUE)

phtest(DONOHUE_within_model, DONOHUE_random_model)


    Hausman Test

data:  Viol_crime_rate_1k_log ~ RTC_LAW + White_Male_15_to_19_years +  ...
chisq = 59.54, df = 11, p-value = 1.129e-08
alternative hypothesis: one model is inconsistent

This test evaluates if there are errors \(u_i\) that are correlated with any of the independent variables.

We reject the null hypothesis, that there are no inconsistencies, and are confirmed in our plan to used a fixed effects model.

For more information on these tests and this package, see here and here.

avocado- stephanie- what do you think about referencing these slides from Princeton?

A final note about the fixed and random effects terminology and how this is slightly different than other definitions:

According to the documentation for the PLM package: >The fixed/random effects terminology in econometrics is often recognized to be misleading, as both are treated as random variates in modern econometrics (see, e.g., Wooldridge (2002) 10.2.1). It has been recognized since Mundlak’s classic paper (Mundlak (1978)) that the fundamental issue is whether the unobserved effects are correlated with the regressors or not. In this last case, they can safely be left in the error term, and the serial correlation they induce is cared for by means of appropriate GLS transformations. On the contrary, in the case of correlation, “fixed effects” methods such as least squares dummy variables or time-demeaning are needed, which explicitly, although inconsistently27, estimate a group– (or time–) invariant additional parameter for each group (or time period).

Thus, from the point of view of model specification, having fixed effects in an econometric model has the meaning of allowing the intercept to vary with group, or time, or both, while the other parameters are generally still assumed to be homogeneous. Having random effects means having a group– (or time–, or both) specific component in the error term.

In the mixed models literature, on the contrary, fixed effect indicates a parameter that is assumed constant, while random effects are parameters that vary randomly around zero according to a joint multivariate normal distribution.

Lott and Mustard

Ok, now we will do the same for the Lott-like analysis. In this case we would have a very large formula to write. So instead, we can use the as.formula() function of the stats package and the base paste() function to combine all of our explanatory variables into one formula without making a mistake. First we will create an object where we select only for the explanatory variables.

avocado I tried using glue or dplyr::collapse to make this tidyverse but this didnt work

LOTT_variables <- LOTT_DF %>%
  dplyr::select(RTC_LAW,
                contains(c("White","Black","Other")),
                Unemployment_rate,
                Poverty_rate,
                Population_log,
                police_per_100k_lag) %>%
  colnames()


LOTT_fmla <- as.formula(paste("Viol_crime_rate_1k_log ~",
                              paste(LOTT_variables, collapse = " + ")
                              )
                        )

LOTT_fmla

Viol_crime_rate_1k_log ~ RTC_LAW + White_Female_10_to_19_years + 
    White_Female_20_to_29_years + White_Female_30_to_39_years + 
    White_Female_40_to_49_years + White_Female_50_to_64_years + 
    White_Female_65_years_and_over + White_Male_10_to_19_years + 
    White_Male_20_to_29_years + White_Male_30_to_39_years + White_Male_40_to_49_years + 
    White_Male_50_to_64_years + White_Male_65_years_and_over + 
    Black_Female_10_to_19_years + Black_Female_20_to_29_years + 
    Black_Female_30_to_39_years + Black_Female_40_to_49_years + 
    Black_Female_50_to_64_years + Black_Female_65_years_and_over + 
    Black_Male_10_to_19_years + Black_Male_20_to_29_years + Black_Male_30_to_39_years + 
    Black_Male_40_to_49_years + Black_Male_50_to_64_years + Black_Male_65_years_and_over + 
    Other_Female_10_to_19_years + Other_Female_20_to_29_years + 
    Other_Female_30_to_39_years + Other_Female_40_to_49_years + 
    Other_Female_50_to_64_years + Other_Female_65_years_and_over + 
    Other_Male_10_to_19_years + Other_Male_20_to_29_years + Other_Male_30_to_39_years + 
    Other_Male_40_to_49_years + Other_Male_50_to_64_years + Other_Male_65_years_and_over + 
    Unemployment_rate + Poverty_rate + Population_log + police_per_100k_lag

That is quite the formula!

Ok, now again we will make a panel data frame and we will perform fit a fixed effect two-way model for time and individuals (STATE) with this data as well.

d_panel_LOTT <- pdata.frame(LOTT_DF, index=c("STATE", "YEAR"))

LOTT_OUTPUT <- plm(LOTT_fmla,
                      model = "within",
                     effect = "twoways",
                       data = d_panel_LOTT)

summary(LOTT_OUTPUT)

Twoways effects Within Model

Call:
plm(formula = LOTT_fmla, data = d_panel_LOTT, effect = "twoways", 
    model = "within")

Balanced Panel: n = 45, T = 31, N = 1395

Residuals:
      Min.    1st Qu.     Median    3rd Qu.       Max. 
-0.5448906 -0.0780395  0.0026738  0.0788052  0.5847263 

Coefficients:
                                  Estimate  Std. Error  t-value  Pr(>|t|)    
RTC_LAWTRUE                    -0.04687169  0.01641851  -2.8548 0.0043758 ** 
White_Female_10_to_19_years     0.62441376  0.15103427   4.1343 3.793e-05 ***
White_Female_20_to_29_years    -0.05942541  0.06332108  -0.9385 0.3481763    
White_Female_30_to_39_years     0.16028113  0.08045953   1.9921 0.0465755 *  
White_Female_40_to_49_years     0.10087510  0.08170707   1.2346 0.2172082    
White_Female_50_to_64_years    -0.37624966  0.06303172  -5.9692 3.083e-09 ***
White_Female_65_years_and_over  0.20636690  0.04742430   4.3515 1.460e-05 ***
White_Male_10_to_19_years      -0.59141591  0.14436974  -4.0965 4.457e-05 ***
White_Male_20_to_29_years       0.08717546  0.05862342   1.4870 0.1372503    
White_Male_30_to_39_years      -0.12514225  0.08588569  -1.4571 0.1453400    
White_Male_40_to_49_years      -0.21812366  0.07293615  -2.9906 0.0028375 ** 
White_Male_50_to_64_years       0.37845575  0.07314122   5.1743 2.653e-07 ***
White_Male_65_years_and_over   -0.20915907  0.06659815  -3.1406 0.0017246 ** 
Black_Female_10_to_19_years    -1.03146594  0.43610403  -2.3652 0.0181697 *  
Black_Female_20_to_29_years    -0.02721685  0.17462559  -0.1559 0.8761693    
Black_Female_30_to_39_years    -0.03246043  0.20498789  -0.1584 0.8742037    
Black_Female_40_to_49_years     0.43820099  0.23524130   1.8628 0.0627234 .  
Black_Female_50_to_64_years     0.04906111  0.21393128   0.2293 0.8186482    
Black_Female_65_years_and_over  0.07226074  0.24373031   0.2965 0.7669130    
Black_Male_10_to_19_years       1.22536162  0.44559642   2.7499 0.0060447 ** 
Black_Male_20_to_29_years      -0.06587312  0.18392655  -0.3581 0.7202909    
Black_Male_30_to_39_years       0.24720746  0.23673862   1.0442 0.2965804    
Black_Male_40_to_49_years      -0.66869983  0.27173041  -2.4609 0.0139904 *  
Black_Male_50_to_64_years      -0.16737616  0.23977741  -0.6980 0.4852740    
Black_Male_65_years_and_over   -0.58743446  0.34691532  -1.6933 0.0906404 .  
Other_Female_10_to_19_years     0.70957924  0.49539878   1.4323 0.1522910    
Other_Female_20_to_29_years    -1.16489945  0.26997487  -4.3148 1.720e-05 ***
Other_Female_30_to_39_years    -3.40258912  0.35368437  -9.6204 < 2.2e-16 ***
Other_Female_40_to_49_years     1.34563633  0.42503994   3.1659 0.0015825 ** 
Other_Female_50_to_64_years     2.93990932  0.33830653   8.6901 < 2.2e-16 ***
Other_Female_65_years_and_over  2.36026239  0.20422580  11.5571 < 2.2e-16 ***
Other_Male_10_to_19_years       0.07481449  0.47835310   0.1564 0.8757423    
Other_Male_20_to_29_years       1.62895925  0.25740603   6.3284 3.420e-10 ***
Other_Male_30_to_39_years       3.17421278  0.41184489   7.7073 2.566e-14 ***
Other_Male_40_to_49_years      -1.58494177  0.44840281  -3.5346 0.0004229 ***
Other_Male_50_to_64_years      -3.91523867  0.37399898 -10.4686 < 2.2e-16 ***
Other_Male_65_years_and_over   -4.16596244  0.36860536 -11.3020 < 2.2e-16 ***
Unemployment_rate              -0.00545734  0.00436374  -1.2506 0.2113054    
Poverty_rate                   -0.00572362  0.00253162  -2.2609 0.0239357 *  
Population_log                 -0.21716335  0.08452664  -2.5692 0.0103068 *  
police_per_100k_lag             0.00069547  0.00013331   5.2171 2.118e-07 ***
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Total Sum of Squares:    43.211
Residual Sum of Squares: 23.647
R-Squared:      0.45275
Adj. R-Squared: 0.40355
F-statistic: 25.8088 on 41 and 1279 DF, p-value: < 2.22e-16

LOTT_OUTPUT_TIDY <- tidy(LOTT_OUTPUT, conf.int = 0.95)

LOTT_OUTPUT_TIDY$Analysis <- "Analysis 2"

RTC coefficient comparison

Now let’s make a plot to compare the coeffecient estimate for the Right-to-carry law adoption variable in each model.

First we will combine model fit information for this coefficient for each model.

comparing_analyses <- DONOHUE_OUTPUT_TIDY %>%
  bind_rows(LOTT_OUTPUT_TIDY) %>%
  filter(term == "RTC_LAWTRUE")

comparing_analyses

# A tibble: 2 x 8
  term        estimate std.error statistic p.value conf.low conf.high Analysis  
  <chr>          <dbl>     <dbl>     <dbl>   <dbl>    <dbl>     <dbl> <chr>     
1 RTC_LAWTRUE   0.0180    0.0166      1.08 0.280    -0.0146    0.0506 Analysis 1
2 RTC_LAWTRUE  -0.0469    0.0164     -2.85 0.00438  -0.0791   -0.0147 Analysis 2

We can see that for the first analysis (similar to the Donohue et al. {target="_blank“} study) the coefficient estimate for the presence of a permissive Right-to-carry law is positive, while for the second analysis (similar to the Lott and Mustard study) the coefficient estimate is negative. Thus in the first analysi we could conclude that the effect of adopting permissive right-to-carry laws may be associated with increases in violent crime (although this was not a significant result (in contrast with the real Donohue et al. {target=”_blank"} study )); while in the other analysis we could conclude that the laws may be associated with decreases in violent crime.

Let’s make a plot of this finding. We will show errorbars for the coefficient estimates for both analyses using the geom_errorbar() function of the ggplot2 package. This requires specifying the minimum and maximum for our errorbar, which in our case we would like to be the low and high values of our confidence intervals for the coefficient estimates. We will also add a horizontal line at y = 0 using the geom_hline() function of the ggplot2 package.

Finally we will add arrows to emphasize the difference in the direction of the findings using the geom_segment() function of the ggplot2 package. Using the arrow() function, we can specify detials about the arrow we would like to add.

#library(grid)

comparing_analyses_plot <- ggplot(comparing_analyses) + 
  geom_point(aes(x = Analysis, y = estimate)) +
  geom_errorbar(aes(x = Analysis, ymin = conf.low, ymax = conf.high), width = 0.25) + 
  geom_hline(yintercept = 0, color = "red") +
  scale_y_continuous(breaks = seq(-0.2, 0.2, by = 0.05),
                     labels = seq(-0.2, 0.2, by = 0.05),
                     limits = c(-0.2,0.2)) +
  geom_segment(aes(x = 1, y = 0.125, xend = 1, yend = 0.175),
               arrow = arrow(angle = 45, ends = "last", type = "open"),
               size = 2,
               color = "green",
               lineend = "butt",
               linejoin = "mitre") +
  geom_segment(aes(x = 2, y = -0.125, xend = 2, yend = -0.175),
               arrow = arrow(angle = 45, ends = "last", type = "open"),
               size = 2,
               color = "red",
               lineend = "butt",
               linejoin = "mitre") +
  theme_minimal() + 
  theme(axis.title.x = element_blank(),
        axis.text = element_text(size = 12)) +
  labs(title = "Effect estimate on ln(violent crimes per 100,000 people)",
       y = "Effect estimate (95% CI)")

comparing_analyses_plot

We can see that most of the possible range of values for the estimate in analysis 1 are positive, while they are all negative for analysis 2.

Multicollinearity analysis

How did the above happen?

The analysis dataframes are very similar yet rendered very different results.

Recall that the only difference is the number of demographic variables. The number of rows or observations is the same. We can use the all_equal() function of the dplyr package to compare the number of columns of our Donohue-like data and our Lott-like data.

all_equal(target = DONOHUE_DF,
          current = LOTT_DF,
          ignore_col_order = TRUE,
          ignore_row_order = TRUE)

- different number of columns: 20 vs 50

Using the base dim() function we can also look at the number of rows for each and see that the number of observatiosn is the same for both datasets.

dim(DONOHUE_DF)[1]

[1] 1395

dim(LOTT_DF)[1]

[1] 1395

The only difference between the two dataframes rests in how the demographic variables were parameterized.

DONOHUE_DF %>%
  dplyr::select(contains("years")) %>%
  colnames()

[1] "Black_Male_15_to_19_years" "Black_Male_20_to_39_years"
[3] "Other_Male_15_to_19_years" "Other_Male_20_to_39_years"
[5] "White_Male_15_to_19_years" "White_Male_20_to_39_years"

LOTT_DF %>%
  dplyr::select(contains("years")) %>%
  colnames()

 [1] "Black_Female_10_to_19_years"    "Black_Female_20_to_29_years"   
 [3] "Black_Female_30_to_39_years"    "Black_Female_40_to_49_years"   
 [5] "Black_Female_50_to_64_years"    "Black_Female_65_years_and_over"
 [7] "Black_Male_10_to_19_years"      "Black_Male_20_to_29_years"     
 [9] "Black_Male_30_to_39_years"      "Black_Male_40_to_49_years"     
[11] "Black_Male_50_to_64_years"      "Black_Male_65_years_and_over"  
[13] "Other_Female_10_to_19_years"    "Other_Female_20_to_29_years"   
[15] "Other_Female_30_to_39_years"    "Other_Female_40_to_49_years"   
[17] "Other_Female_50_to_64_years"    "Other_Female_65_years_and_over"
[19] "Other_Male_10_to_19_years"      "Other_Male_20_to_29_years"     
[21] "Other_Male_30_to_39_years"      "Other_Male_40_to_49_years"     
[23] "Other_Male_50_to_64_years"      "Other_Male_65_years_and_over"  
[25] "White_Female_10_to_19_years"    "White_Female_20_to_29_years"   
[27] "White_Female_30_to_39_years"    "White_Female_40_to_49_years"   
[29] "White_Female_50_to_64_years"    "White_Female_65_years_and_over"
[31] "White_Male_10_to_19_years"      "White_Male_20_to_29_years"     
[33] "White_Male_30_to_39_years"      "White_Male_40_to_49_years"     
[35] "White_Male_50_to_64_years"      "White_Male_65_years_and_over"

Clearly, this had an effect on the results of the analysis.

Let’s explore how this occured.

When seemingly independent variables are highly related to one another, the relationships estimated in an analysis may be distorted.

In regression analysis, this distortion is often a by-product of a violation of the independence assumption. This distortion, if large enough, can impact statistical inference.

The phenomona called multicollinearity occurs when independent variables are highly related to one another

There are several ways we can diagnose multicollinearity.

Correlation

One way we can evaluate the relationships between variables is by examining the correlation between variable pairs.

It is important to note that multicollinearity and correlation are not one and the same. Correlation can be thought of as the strength of the relationship between variables. On the other hand, multicollinearity can be thought of as the the violation of the independence assumption that is a consequence of this correlation in a regression analysis.

Scatterplots

One way to look at correlatin across pairs of variables is to use the ggpairs() function of the GGally package.

colnames(DONOHUE_DF)

 [1] "YEAR"                      "STATE"                    
 [3] "Black_Male_15_to_19_years" "Black_Male_20_to_39_years"
 [5] "Other_Male_15_to_19_years" "Other_Male_20_to_39_years"
 [7] "White_Male_15_to_19_years" "White_Male_20_to_39_years"
 [9] "Unemployment_rate"         "Poverty_rate"             
[11] "Viol_crime_count"          "Population"               
[13] "police_per_100k_lag"       "RTC_LAW_YEAR"             
[15] "RTC_LAW"                   "TIME_0"                   
[17] "TIME_INF"                  "Viol_crime_rate_1k"       
[19] "Viol_crime_rate_1k_log"    "Population_log"

DONOHUE_DF %>% 
  dplyr::select(RTC_LAW,
                Viol_crime_rate_1k_log,
                Unemployment_rate,
                Poverty_rate,
                Population_log) %>% 
  ggpairs(.,
          columns = c(2:5),
          lower = list(continuous = wrap("smooth_loess",
                                         color = "red",
                                         alpha = 0.5,
                                         size = 0.1)))

We can see that for the non-demographic variables, there is very little correlation between the pairs of variables. Only the unemployment rate and the poverty rate show relatively strong correlation, as one might expect.

Heatmaps

Another way to look at correlation if we have many variables is to use heatmaps.

Let’s to this now for the deomographic variables for each analysis.

The ggcorrplot() function of the ggpcorplot package is one way to create such a heatmap.

This requires first calculating the correaltion values using the cor() function of the stats package.

cor_DONOHUE_dem <- cor(DONOHUE_DF %>% dplyr::select(contains("_years")))

corr_mat_DONOHUE <- ggcorrplot(cor_DONOHUE_dem,
           tl.cex = 6,
           hc.order = TRUE,
           colors = c("red",
                      "white",
                      "red"),
           outline.color = "transparent",
           title = "Correlation Matrix, Analysis 1",
           legend.title = TeX("$\\rho$"))

corr_mat_DONOHUE

cor_LOTT_dem <- cor(LOTT_DF %>% dplyr::select(contains("_years")))

corr_mat_LOTT <- ggcorrplot(cor_LOTT_dem,
           tl.cex = 6,
           hc.order = TRUE,
           colors = c("red",
                      "white",
                      "red"),
           outline.color = "transparent",
           title = "Correlation Matrix, Analysis 2",
           legend.title = TeX("$\\rho$"))

corr_mat_LOTT

We can see that many of the demographic variables are highly correlated with one another.

The presence of correlation bewteen variables suggests that we might have multicollinearity. However it does not necessarily mean that we do. So how can we assess this?

Coefficient estimate instability

One way to look at the possible influence of multicollinearit is to look at the stability of the coefficient estimates.

We will focus on the RTC_LAW variable coefficient estimate, as this is of particular interest in our case.

To do so we will perform multiple iterations of our analysis, but we will remove one observation and see if that changes our coefficient estimate results.

To do this we will use some functions in the rsample package which is very useful for splitting data in various ways.

We will use the loo_cv() function which stands for leave one out cross validation. This will allow us to split our data into every possible subset where a unique observation is left out of the data.

This function will however only prepare the data to be split.

To actually get the remaining data after the removal of the observation that is left out when need to use a function called training(). This is because these functions are often used for in machine learning applications where the data is split between a larger training set and a smaller testing set. Thus we want the larger \(n-1\) subset, as opposed to the single value that is removed, (which we could get with the testing() function)

avocado move this:Note that this causes our data to be an unbalanced panel. This does not require any adjustment to the code to model the data, but you will notice that the output will now say “unbalanced”.

Click here to see an example of how this works.

First we will make a toy dataset that is very simle called test using the tibble() function of the tidyr package:

test <-tidyr::tibble(x = c(1,2,3))
test

# A tibble: 3 x 1
      x
  <dbl>
1     1
2     2
3     3

Now we will use the loo_cv() to create leave one out splits:

test_samples <- test %>% loo_cv()
test_samples

# Leave-one-out cross-validation 
# A tibble: 3 x 2
  splits        id       
  <list>        <chr>    
1 <split [2/1]> Resample1
2 <split [2/1]> Resample2
3 <split [2/1]> Resample3

We can take a look at one individual split using the pull() function:

pull(test_samples, splits)

[[1]]
<Analysis/Assess/Total>
<2/1/3>

[[2]]
<Analysis/Assess/Total>
<2/1/3>

[[3]]
<Analysis/Assess/Total>
<2/1/3>

Here you can see that 2 values are intended for the training set (aslo called Analysis set), 1 value is intended for the testing set (also called Assessment set), and 3 values were present initially.

Now we will use the training() function to get the data without the obersvation that is set aside. Here is the data for the first subset:

training(pull(test_samples, splits)[[1]])

# A tibble: 2 x 1
      x
  <dbl>
1     1
2     2

Now we will use the map() function of purrr to get all possible training subset of the data.

test_subsets <- map(pull(test_samples, splits), training)
test_subsets

[[1]]
# A tibble: 2 x 1
      x
  <dbl>
1     1
2     2

[[2]]
# A tibble: 2 x 1
      x
  <dbl>
1     2
2     3

[[3]]
# A tibble: 2 x 1
      x
  <dbl>
1     1
2     3

We can see that there are 3 possible subsets that leave one value out. All 3 possible subsets are created using this method. This method will always create the same number of subsets as there are unqiue values or rows in the data.

Now we will use this method with the data from our Donohue-like analysis, since this data has dim(d_panel_DONOHUE)[1] rows, dim(d_panel_DONOHUE)[1] subsets will be created that leave out one row.

First we will create the splits using the loo_cv() function:

set.seed(124)
DONOHUE_splits <- d_panel_DONOHUE %>% loo_cv()
DONOHUE_splits

# Leave-one-out cross-validation 
# A tibble: 1,395 x 2
   splits           id        
   <list>           <chr>     
 1 <split [1.4K/1]> Resample1 
 2 <split [1.4K/1]> Resample2 
 3 <split [1.4K/1]> Resample3 
 4 <split [1.4K/1]> Resample4 
 5 <split [1.4K/1]> Resample5 
 6 <split [1.4K/1]> Resample6 
 7 <split [1.4K/1]> Resample7 
 8 <split [1.4K/1]> Resample8 
 9 <split [1.4K/1]> Resample9 
10 <split [1.4K/1]> Resample10
# … with 1,385 more rows

Now we will use the training() function to select the remaining data without the value that was removed for each split:

# To get all the data subsets
DONOHUE_subsets <-map(pull(DONOHUE_splits, splits), training)

glimpse(DONOHUE_subsets[[1]])

Rows: 1,394
Columns: 20
$ YEAR                      <fct> 1980, 1981, 1982, 1983, 1984, 1985, 1986, 1…
$ STATE                     <fct> Alaska, Alaska, Alaska, Alaska, Alaska, Ala…
$ Black_Male_15_to_19_years <pseries> 0.1670456, 0.1732299, 0.1737069, 0.1709…
$ Black_Male_20_to_39_years <pseries> 0.9933775, 1.0028219, 1.0204445, 1.0312…
$ Other_Male_15_to_19_years <pseries> 1.1297816, 1.1244412, 1.0698208, 0.9882…
$ Other_Male_20_to_39_years <pseries> 2.963329, 2.974775, 3.015071, 3.008048,…
$ White_Male_15_to_19_years <pseries> 3.627805, 3.558261, 3.391844, 3.222002,…
$ White_Male_20_to_39_years <pseries> 18.28852, 18.12821, 18.10666, 17.90600,…
$ Unemployment_rate         <pseries> 9.6, 9.4, 9.9, 9.9, 9.8, 9.7, 10.9, 10.…
$ Poverty_rate              <pseries> 9.6, 9.0, 10.6, 12.6, 9.6, 8.7, 11.4, 1…
$ Viol_crime_count          <pseries> 1919, 2537, 2732, 2940, 3108, 3031, 304…
$ Population                <pseries> 404680, 418519, 449608, 488423, 513697,…
$ police_per_100k_lag       <pseries> 194.7218, 200.2299, 191.0553, 364.2335,…
$ RTC_LAW_YEAR              <pseries> 1995, 1995, 1995, 1995, 1995, 1995, 199…
$ RTC_LAW                   <pseries> FALSE, FALSE, FALSE, FALSE, FALSE, FALS…
$ TIME_0                    <pseries> 1980, 1980, 1980, 1980, 1980, 1980, 198…
$ TIME_INF                  <pseries> 2010, 2010, 2010, 2010, 2010, 2010, 201…
$ Viol_crime_rate_1k        <pseries> 4.742018, 6.061851, 6.076404, 6.019373,…
$ Viol_crime_rate_1k_log    <pseries> 1.556463, 1.802015, 1.804413, 1.794983,…
$ Population_log            <pseries> 12.91085, 12.94448, 13.01613, 13.09894,…

length(DONOHUE_subsets)

[1] 1395

As expected the first subset has 1,394 rows and there are 1395 subsets.

Let’s see what obsevation was left out in the first subset:

d_panel_DONOHUE %>%
  filter(! rownames(d_panel_DONOHUE)  %in% rownames(DONOHUE_subsets[[1]]))

           YEAR STATE Black_Male_15_to_19_years Black_Male_20_to_39_years
Texas-1988 1988 Texas                 0.5599219                  2.091018
           Other_Male_15_to_19_years Other_Male_20_to_39_years
Texas-1988                0.09824717                 0.4413413
           White_Male_15_to_19_years White_Male_20_to_39_years
Texas-1988                  3.447339                  14.79001
           Unemployment_rate Poverty_rate Viol_crime_count Population
Texas-1988               7.3           18           109499   16667146
           police_per_100k_lag RTC_LAW_YEAR RTC_LAW TIME_0 TIME_INF
Texas-1988            298.2274         1996   FALSE   1980     2010
           Viol_crime_rate_1k Viol_crime_rate_1k_log Population_log
Texas-1988           6.569751               1.882476       16.62895

# Another way to check is to use:
DONOHUE_removed <-map(pull(DONOHUE_splits, splits), testing)

DONOHUE_removed[[1]]

           YEAR STATE Black_Male_15_to_19_years Black_Male_20_to_39_years
Texas-1988 1988 Texas                 0.5599219                  2.091018
           Other_Male_15_to_19_years Other_Male_20_to_39_years
Texas-1988                0.09824717                 0.4413413
           White_Male_15_to_19_years White_Male_20_to_39_years
Texas-1988                  3.447339                  14.79001
           Unemployment_rate Poverty_rate Viol_crime_count Population
Texas-1988               7.3           18           109499   16667146
           police_per_100k_lag RTC_LAW_YEAR RTC_LAW TIME_0 TIME_INF
Texas-1988            298.2274         1996   FALSE   1980     2010
           Viol_crime_rate_1k Viol_crime_rate_1k_log Population_log
Texas-1988           6.569751               1.882476       16.62895

It looks like the Texas data from 1988 was removed from the first split.

OK, so now let’s fit our panel regression on the first subset of data like we did previously:

 subset_1_result<-plm(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag,
                        data = DONOHUE_subsets[[1]],
                       index = c("STATE","YEAR"),
                       model = "within",
                      effect = "twoways")
summary(subset_1_result)

Twoways effects Within Model

Call:
plm(formula = Viol_crime_rate_1k_log ~ RTC_LAW + White_Male_15_to_19_years + 
    White_Male_20_to_39_years + Black_Male_15_to_19_years + Black_Male_20_to_39_years + 
    Other_Male_15_to_19_years + Other_Male_20_to_39_years + Unemployment_rate + 
    Poverty_rate + Population_log + police_per_100k_lag, data = DONOHUE_subsets[[1]], 
    effect = "twoways", model = "within", index = c("STATE", 
        "YEAR"))

Unbalanced Panel: n = 45, T = 30-31, N = 1394

Residuals:
      Min.    1st Qu.     Median    3rd Qu.       Max. 
-0.5795659 -0.0893732 -0.0014097  0.0865870  1.1118927 

Coefficients:
                             Estimate  Std. Error t-value  Pr(>|t|)    
RTC_LAWTRUE                0.01812436  0.01664364  1.0890 0.2763694    
White_Male_15_to_19_years -0.00103284  0.02724763 -0.0379 0.9697687    
White_Male_20_to_39_years  0.03462260  0.00973037  3.5582 0.0003868 ***
Black_Male_15_to_19_years -0.05699742  0.05747236 -0.9917 0.3215097    
Black_Male_20_to_39_years  0.12591876  0.01931901  6.5179 1.016e-10 ***
Other_Male_15_to_19_years  0.69114956  0.11325143  6.1028 1.371e-09 ***
Other_Male_20_to_39_years -0.30242747  0.03812860 -7.9318 4.603e-15 ***
Unemployment_rate         -0.01698131  0.00490345 -3.4631 0.0005512 ***
Poverty_rate              -0.00782727  0.00295795 -2.6462 0.0082384 ** 
Population_log            -0.17899715  0.06044257 -2.9614 0.0031173 ** 
police_per_100k_lag        0.00060326  0.00013692  4.4058 1.140e-05 ***
---
Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

Total Sum of Squares:    43.198
Residual Sum of Squares: 36.701
R-Squared:      0.15039
Adj. R-Squared: 0.095183
F-statistic: 21.0489 on 11 and 1308 DF, p-value: < 2.22e-16

Indeed, we can see that now we have an unbalanced panel with N = 1394 observations instead of 1395, as expected.

Now that we have our subsets, we want to write a function to fit a panel regression using plm()on each subsets. See this case study for more information on writing functions.

avocado add bootstarp description maybe link about cross validation- testing and training sets

fit_nls_on_bootstrap_DONOHUE <- function(subset){
                    plm(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag,
                        data = data.frame(subset),
                       index = c("STATE","YEAR"),
                       model = "within",
                      effect = "twoways")
}

Now we can apply this function to each of our subsets simultaneously using the map() function of the purrr package.

subsets_models_DONOHUE <- map(DONOHUE_subsets, fit_nls_on_bootstrap_DONOHUE)

subsets_models_DONOHUE <- subsets_models_DONOHUE %>%
  map(tidy)

Great! Now we want to do the same thing for the Lott data.

set.seed(124)
LOTT_splits <- d_panel_LOTT %>% loo_cv()

# To get all the data subsets:
LOTT_subsets <-map(pull(LOTT_splits, splits), training)

We need to create a different function to fit the data to account for the larger number of demographic variables. We will use the formula that we made previously.

fit_nls_on_bootstrap_LOTT <- function(split){
  plm(LOTT_fmla,
      data = data.frame(split),
      index = c("STATE","YEAR"),
      model = "within",
      effect = "twoways")
}


subsets_models_LOTT <- map(LOTT_subsets, fit_nls_on_bootstrap_LOTT)

subsets_models_LOTT <- subsets_models_LOTT %>%
  map(tidy)

Now we will combine the output so that we can make a plot to visualize the results that we obtained. First let’s name each subset that we created.

names(subsets_models_DONOHUE) <-     paste0("DONOHUE_",1:length(subsets_models_DONOHUE))

names(subsets_models_LOTT) <- 
paste0("LOTT_",1:length(subsets_models_LOTT))

Now we can combine the tibbles within the list of tibbles for the subsets_models_DONOHUE and subsets_models_LOTT data.

To do this we will use the bind_rows() function of the dplyr package with the .id = "ID" argument, which will create a new variable called ID that will list the name of the tibble the data came from.

Then we will combine the data from both the Donohue and Lott simulations.

simulations_DONOHUE <- subsets_models_DONOHUE %>%
  bind_rows(.id = "ID") %>%
  mutate(Analysis = "Analysis 1")

simulations_LOTT <- subsets_models_LOTT %>%
  bind_rows(.id = "ID") %>%
  mutate(Analysis = "Analysis 2")

simulations <- bind_rows(simulations_DONOHUE,
                         simulations_LOTT)

head(simulations)

# A tibble: 6 x 7
  ID        term                 estimate std.error statistic  p.value Analysis 
  <chr>     <chr>                   <dbl>     <dbl>     <dbl>    <dbl> <chr>    
1 DONOHUE_1 RTC_LAWTRUE           0.0181    0.0166     1.09   2.76e- 1 Analysis…
2 DONOHUE_1 White_Male_15_to_19… -0.00103   0.0272    -0.0379 9.70e- 1 Analysis…
3 DONOHUE_1 White_Male_20_to_39…  0.0346    0.00973    3.56   3.87e- 4 Analysis…
4 DONOHUE_1 Black_Male_15_to_19… -0.0570    0.0575    -0.992  3.22e- 1 Analysis…
5 DONOHUE_1 Black_Male_20_to_39…  0.126     0.0193     6.52   1.02e-10 Analysis…
6 DONOHUE_1 Other_Male_15_to_19…  0.691     0.113      6.10   1.37e- 9 Analysis…

tail(simulations)

# A tibble: 6 x 7
  ID       term                  estimate std.error statistic  p.value Analysis 
  <chr>    <chr>                    <dbl>     <dbl>     <dbl>    <dbl> <chr>    
1 LOTT_13… Other_Male_50_to_64_… -3.91e+0  0.375       -10.4  1.66e-24 Analysis…
2 LOTT_13… Other_Male_65_years_… -4.16e+0  0.369       -11.3  3.97e-28 Analysis…
3 LOTT_13… Unemployment_rate     -5.43e-3  0.00437      -1.24 2.14e- 1 Analysis…
4 LOTT_13… Poverty_rate          -5.75e-3  0.00253      -2.27 2.33e- 2 Analysis…
5 LOTT_13… Population_log        -2.16e-1  0.0846       -2.55 1.08e- 2 Analysis…
6 LOTT_13… police_per_100k_lag    6.96e-4  0.000133      5.22 2.07e- 7 Analysis…

Now we will make a jitter plot using the geom_jitter() function of the coefficient estimates of the RTC_LAWTRUE variable for each simulation.

simulation_plot <- simulations %>%
  filter(term=="RTC_LAWTRUE") %>%
  ggplot(aes(x = Analysis, y = estimate)) + 
  geom_jitter(alpha = 0.25,
              width = 0.1) + 
  labs(title = "Coefficient instability",
       subtitle = "Estimates sensitive to observation deletions",
       x = "Term",
       y = "Coefficient",
       caption = "Results from simulations") + 
  theme_minimal() +
  theme(axis.title.x = element_blank())

simulation_plot

from Michael

sims <- 250

# DONOHUE
samps_DONOHUE <- lapply(rep(dim(DONOHUE_DF)[1]-1, sims),
       function(x)DONOHUE_DF[sample(nrow(DONOHUE_DF),
                                     size = x, replace = FALSE),])

fit_nls_on_bootstrap_DONOHUE <- function(split){
  plm(Viol_crime_rate_1k_log ~
                        RTC_LAW +
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log + 
                        police_per_100k_lag,
      data = data.frame(split),
      index = c("STATE","YEAR"),
      model = "within",
      effect = "twoways")
}
  
samps_models_DONOHUE <- lapply(samps_DONOHUE, fit_nls_on_bootstrap_DONOHUE)

samps_models_DONOHUE <- samps_models_DONOHUE %>%
  map(tidy)

names(samps_models_DONOHUE) <- paste0("DONOHUE_",1:length(samps_models_DONOHUE))

simulations_DONOHUE <- samps_models_DONOHUE %>%
  bind_rows(.id = "ID") %>%
  mutate(Analysis = "Analysis 1")

## LOTT

samps_LOTT <- lapply(rep(round(dim(LOTT_DF)[1]/2), sims),
       function(x) LOTT_DF[sample(nrow(LOTT_DF),
                                  size = x, replace = FALSE),])

fit_nls_on_bootstrap_LOTT <- function(split){
  plm(LOTT_fmla,
      data = data.frame(split),
      index = c("STATE","YEAR"),
      model = "within",
      effect = "twoways")
}
  
samps_models_LOTT <- lapply(samps_LOTT, fit_nls_on_bootstrap_LOTT)

samps_models_LOTT <- samps_models_LOTT %>%
  map(tidy)

names(samps_models_LOTT) <- paste0("LOTT_",1:length(samps_models_LOTT))

simulations_LOTT <- samps_models_LOTT %>%
  bind_rows(.id = "Analysis") %>%
  mutate(Analysis = "Analysis 2")

simulations <- bind_rows(simulations_DONOHUE,
                         simulations_LOTT)

simulation_plot <- simulations %>%
  filter(term=="RTC_LAWTRUE") %>%
  ggplot(aes(x = Analysis, y = estimate)) + 
  geom_jitter(alpha = 0.25,
              width = 0.1) + 
  labs(title = "Coefficient instability",
       subtitle = "Estimates sensitive to observation deletions",
       x = "Term",
       y = "Coefficient",
       caption = "Results from simulations") + 
  theme_minimal() +
  theme(axis.title.x = element_blank())

simulation_plot

VIF

design.matrix <- as.data.frame(model.matrix(DONOHUE_OUTPUT))

design.matrix$Viol_crime_rate_1k_log <- plm::Within(
  d_panel_DONOHUE$Viol_crime_rate_1k_log)

lm_DONOHUE <- lm(Viol_crime_rate_1k_log ~
                        RTC_LAWTRUE + # logical class changes variable name after inital model
                        White_Male_15_to_19_years +
                        White_Male_20_to_39_years +
                        Black_Male_15_to_19_years +
                        Black_Male_20_to_39_years +
                        Other_Male_15_to_19_years +
                        Other_Male_20_to_39_years +
                        Unemployment_rate +
                        Poverty_rate + 
                        Population_log +
               police_per_100k_lag,
             data = design.matrix)


vif(lm_DONOHUE)

              RTC_LAWTRUE White_Male_15_to_19_years White_Male_20_to_39_years 
                 1.097853                  1.172339                  1.738459 
Black_Male_15_to_19_years Black_Male_20_to_39_years Other_Male_15_to_19_years 
                 1.344193                  1.653712                  1.586648 
Other_Male_20_to_39_years         Unemployment_rate              Poverty_rate 
                 1.529688                  1.244667                  1.270321 
           Population_log       police_per_100k_lag 
                 1.153933                  1.204491

vif_DONOHUE <- vif(lm_DONOHUE)

vif_DONOHUE <- vif_DONOHUE %>%
  as_tibble() %>%
  cbind(., names(vif_DONOHUE)) %>%
  as_tibble()
  
colnames(vif_DONOHUE) <- c("VIF", "Variable")

max_vif_DONOHUE <- max(vif(lm_DONOHUE))

design.matrix <- as.data.frame(model.matrix(LOTT_OUTPUT))

design.matrix$Viol_crime_rate_1k_log <- plm::Within(
  d_panel_LOTT$Viol_crime_rate_1k_log)

LOTT_variables_ols <- LOTT_DF %>%
  dplyr::select(RTC_LAW,
                contains(c("White","Black","Other")),
                Unemployment_rate,
                Poverty_rate,
                Population_log,
                police_per_100k_lag) %>%
  colnames() %>%
  str_replace("RTC_LAW", "RTC_LAWTRUE") # logical class changes variable name after inital model

LOTT_fmla_ols <- as.formula(paste("Viol_crime_rate_1k_log ~",
                              paste(LOTT_variables_ols, collapse = " + ")
                              )
                        )

lm_LOTT <- lm(LOTT_fmla_ols,
             data = design.matrix)

vif(lm_LOTT)

                   RTC_LAWTRUE    White_Female_10_to_19_years 
                      1.621662                     127.920555 
   White_Female_20_to_29_years    White_Female_30_to_39_years 
                     42.269637                      49.635014 
   White_Female_40_to_49_years    White_Female_50_to_64_years 
                     37.550101                      36.451868 
White_Female_65_years_and_over      White_Male_10_to_19_years 
                     12.866751                     126.824984 
     White_Male_20_to_29_years      White_Male_30_to_39_years 
                     39.248785                      73.008959 
     White_Male_40_to_49_years      White_Male_50_to_64_years 
                     31.613855                      52.774694 
  White_Male_65_years_and_over    Black_Female_10_to_19_years 
                     13.285326                     335.136906 
   Black_Female_20_to_29_years    Black_Female_30_to_39_years 
                    106.644486                      79.058455 
   Black_Female_40_to_49_years    Black_Female_50_to_64_years 
                     98.434064                      66.888057 
Black_Female_65_years_and_over      Black_Male_10_to_19_years 
                     49.715869                     320.740453 
     Black_Male_20_to_29_years      Black_Male_30_to_39_years 
                     89.297151                      89.267356 
     Black_Male_40_to_49_years      Black_Male_50_to_64_years 
                     92.498486                      64.538516 
  Black_Male_65_years_and_over    Other_Female_10_to_19_years 
                     37.960126                     142.283700 
   Other_Female_20_to_29_years    Other_Female_30_to_39_years 
                     64.966861                      54.511835 
   Other_Female_40_to_49_years    Other_Female_50_to_64_years 
                    224.567085                     131.463113 
Other_Female_65_years_and_over      Other_Male_10_to_19_years 
                     82.394398                     151.930450 
     Other_Male_20_to_29_years      Other_Male_30_to_39_years 
                     54.620045                      62.267344 
     Other_Male_40_to_49_years      Other_Male_50_to_64_years 
                    244.698473                     174.184553 
  Other_Male_65_years_and_over              Unemployment_rate 
                     53.532299                       1.497864 
                  Poverty_rate                 Population_log 
                      1.412397                       3.426475 
           police_per_100k_lag 
                      1.732745

vif_LOTT <- vif(lm_LOTT)

vif_LOTT <- vif_LOTT %>%
  as_tibble() %>%
  cbind(., names(vif_LOTT)) %>%
  as_tibble()
  
colnames(vif_LOTT) <- c("VIF", "Variable")

max_vif_LOTT <- max(vif(lm_LOTT))

[1] 1.738459

[1] 335.1369

\[\frac{1}{1-R_{i}^{2}}\]

vif_DONOHUE$Analysis <- "Analysis 1"
vif_LOTT$Analysis <- "Analysis 2"

vif_df <- rbind(vif_DONOHUE,
                vif_LOTT)

vif_plot <- vif_df %>%
  ggplot(aes(x = Analysis, y = VIF)) +
  geom_jitter(width = 0.1, alpha = 0.5, size = 2) +
  geom_hline(yintercept = 10, color = "red") +
  scale_y_continuous(trans = 'log10',
                     limits = c(1,1000)) +
  labs(title = "Variance inflation factors") + 
  theme_minimal() +
  theme(axis.title.x = element_blank())

vif_plot

Synthesis

Data Visualization

Summary

Suggested Homework

Additional Information

*Helpful Links

Tidyverse
Writing functions
Longitudinal studies
Panel data
Confidence intervals
Linear regression model

For more information on linear regression see this book and this case study.

avocado fill this out

https://rpubs.com/rslbliss/fixed_effects

http://karthur.org/2019/implementing-fixed-effects-panel-models-in-r.html

https://stats.stackexchange.com/questions/99236/effects-in-panel-models-individual-time-or-twoways

Acknowledgements

We would like to acknowledge Daniel Webster for assisting in framing the major direction of the case study.

We would also like to acknowledge the Bloomberg American Health Initiative for funding this work.

LS0tCnRpdGxlOiAiT3BlbiBDYXNlIFN0dWRpZXM6IEV4YW1pbmF0aW9uIG9mIE11bHRpY29sbGluZWFyaXR5IEluZmx1ZW5jZSBvbiBJbmZlcmVuY2UgVXNpbmcgUmlnaHQtdG8tQ2FycnkgR3VuIExhdyBhbmQgVmlvbGVudCBDcmltZSBEYXRhIgphdXRob3I6ICJNaWNoYWVsIE9udGl2ZXJvcywgQ2FycmllIFdyaWdodCwgUGhELiIKY3NzOiBzdHlsZS5jc3MKb3V0cHV0OgogIGh0bWxfZG9jdW1lbnQ6CiAgICBzZWxmX2NvbnRhaW5lZDogeWVzCiAgICBjb2RlX2Rvd25sb2FkOiB5ZXMKICAgIGhpZ2hsaWdodDogdGFuZ28KICAgIG51bWJlcl9zZWN0aW9uczogbm8KICAgIHRoZW1lOiBjb3NtbwogICAgdG9jOiB5ZXMKICAgIHRvY19mbG9hdDogeWVzCiAgcGRmX2RvY3VtZW50OgogICAgdG9jOiB5ZXMKICB3b3JkX2RvY3VtZW50OgogICAgdG9jOiB5ZXMKLS0tCgo8c3R5bGU+CiNUT0MgewogIGJhY2tncm91bmQ6IHVybCgiaHR0cHM6Ly9vcGVuY2FzZXN0dWRpZXMuZ2l0aHViLmlvL2ltZy9sb2dvLmpwZyIpOwogIGJhY2tncm91bmQtc2l6ZTogY29udGFpbjsKICBwYWRkaW5nLXRvcDogMjQwcHggIWltcG9ydGFudDsKICBiYWNrZ3JvdW5kLXJlcGVhdDogbm8tcmVwZWF0Owp9Cjwvc3R5bGU+CgoKLS0tCgoKYGBge3Igc2V0dXAsIGluY2x1ZGU9RkFMU0V9CmtuaXRyOjpvcHRzX2NodW5rJHNldChpbmNsdWRlID0gVFJVRSwgY29tbWVudCA9IE5BLCBlY2hvID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgIG1lc3NhZ2UgPSBGQUxTRSwgd2FybmluZyA9IEZBTFNFLCBjYWNoZSA9IEZBTFNFLCBmaWcud2lkdGg9MTAsIGZpZy5oZWlnaHQ9NywKICAgICAgICAgICAgICAgICAgICAgIGZpZy5hbGlnbiA9ICJjZW50ZXIiLCBvdXQud2lkdGggPSAnOTAlJykKbGlicmFyeShoZXJlKQpsaWJyYXJ5KGtuaXRyKQoKYGBgCgoKCgojIyMjIHsub3V0bGluZSB9CmBgYHtyLCBlY2hvID0gRkFMU0UsIG91dC53aWR0aCA9ICI4MDAgcHgifQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlOjpoZXJlKCJpbWciLCAibWFpbnBsb3QucG5nIikpCmBgYAoKIyMjIwoKIyMgey5kaXNjbGFpbWVyX2Jsb2NrfQoKKipEaXNjbGFpbWVyKio6IFRoZSBwdXJwb3NlIG9mIHRoZSBbT3BlbiBDYXNlIFN0dWRpZXNdKGh0dHBzOi8vb3BlbmNhc2VzdHVkaWVzLmdpdGh1Yi5pbyl7dGFyZ2V0PSJfYmxhbmsifSBwcm9qZWN0IGlzICoqdG8gZGVtb25zdHJhdGUgdGhlIHVzZSBvZiB2YXJpb3VzIGRhdGEgc2NpZW5jZSBtZXRob2RzLCB0b29scywgYW5kIHNvZnR3YXJlIGluIHRoZSBjb250ZXh0IG9mIG1lc3N5LCByZWFsLXdvcmxkIGRhdGEqKi4gQSBnaXZlbiBjYXNlIHN0dWR5IGRvZXMgbm90IGNvdmVyIGFsbCBhc3BlY3RzIG9mIHRoZSByZXNlYXJjaCBwcm9jZXNzLCBpcyBub3QgY2xhaW1pbmcgdG8gYmUgdGhlIG1vc3QgYXBwcm9wcmlhdGUgd2F5IHRvIGFuYWx5emUgYSBnaXZlbiBkYXRhIHNldCwgYW5kIHNob3VsZCBub3QgYmUgdXNlZCBpbiB0aGUgY29udGV4dCBvZiBtYWtpbmcgcG9saWN5IGRlY2lzaW9ucyB3aXRob3V0IGV4dGVybmFsIGNvbnN1bHRhdGlvbiBmcm9tIHNjaWVudGlmaWMgZXhwZXJ0cy4gCgojIyB7LmxpY2Vuc2VfYmxvY2t9CgpUaGlzIHdvcmsgaXMgbGljZW5zZWQgdW5kZXIgdGhlIENyZWF0aXZlIENvbW1vbnMgQXR0cmlidXRpb24tTm9uQ29tbWVyY2lhbCAzLjAgWyhDQyBCWS1OQyAzLjApXShodHRwczovL2NyZWF0aXZlY29tbW9ucy5vcmcvbGljZW5zZXMvYnktbmMvMy4wL3VzLyl7dGFyZ2V0PSJfYmxhbmsifSAgVW5pdGVkIFN0YXRlcyBMaWNlbnNlLgoKIyAqKk1vdGl2YXRpb24qKgoqKiogCgpUaGlzIGNhc2Ugc3R1ZHkgd2lsbCBpbnRyb2R1Y2UgdGhlIHRvcGljIG9mIG11bHRpY29saW5lYXJpdHkuIFdlIHdpbGwgZG8gc28gYnkgc2hvd2Nhc2luZyBhIHJlYWwgd29ybGQgZXhhbXBsZSB3aGVyZSBtdWx0aWNvbGluZWFyaXR5IGluIHBhcnQgcmVzdWx0ZWQgaW4gaGlzdG9yaWNhbGx5IGNvbnRyaXZlcnNpYWwgYW5kIGNvbmZsaWN0aW5nIGZpbmRpbmdzIGFib3V0IHRoZSBpbmZsdWVuY2Ugb2YgdGhlIGFkb3B0aW9uIG9mIHJpZ2h0LXRvLWNhcnJ5IChSVEMpIGNvbmNlYWxlZCBoYW5kZ3VuIGxhd3Mgb24gdmlvbGVudCBjcmltZSByYXRlcyBpbiB0aGUgVW5pdGVkIFN0YXRlcy4gCgpXZSB3aWxsIGZvY3VzIG9uIHR3byBhcnRpY2xlczoKCjEpIFRoZSBmaXJzdCBhbmFseXNpcyBieSBbTG90dCBhbmQgTXVzdGFyZF0oaHR0cHM6Ly9jaGljYWdvdW5ib3VuZC51Y2hpY2Fnby5lZHUvY2dpL3ZpZXdjb250ZW50LmNnaT9hcnRpY2xlPTExNTAmY29udGV4dD1sYXdfYW5kX2Vjb25vbWljcyl7dGFyZ2V0PSJfYmxhbmsifSBwdWJsaXNoZWQgaW4gMTk5NiBzdWdnZXN0cyB0aGF0IFJUQyBsYXdzIHJlZHVjZSB2aW9sZW50IGNyaW1lLiBMb3R0IGF1dGhvcmVkIGEgYm9vayBleHRlbmRpbmcgdGhlc2UgZmluZGluZ3MgaW4gMTk5OCBjYWxsZWQgWyoqKk1vcmUgR3VucywgTGVzcyBDcmltZSoqKl0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvTW9yZV9HdW5zLF9MZXNzX0NyaW1lKXt0YXJnZXQ9Il9ibGFuayJ9LgoKYGBge3IsIGVjaG89RkFMU0UsIG91dC5oZWlnaHQgPSAnMTAwJScsIG91dC53aWR0aCA9ICcxMDAlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCAiTG90dC5wbmciKSkKYGBgCgoyKSBUaGUgc2Vjb25kIGFuYWx5c2lzIGlzIGEgcmVjZW50IGFydGljbGUgYnkgW0Rvbm9odWUsIGV0IGFsLl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpe3RhcmdldD0iX2JsYW5rIn0gcHVibGlzaGVkIGluIDIwMTcgdGhhdCBzdWdnZXN0cyB0aGF0IFJUQyBsYXdzIGluY3JlYXNlIHZpb2xlbnQgY3JpbWUuIERvbm9odWUgaGFzIGFsc28gcHVibGlzaGVkIHByZXZpb3VzIGFydGljbGVzIHdpdGggdGl0bGVzIHN1Y2ggYXMgWyoqKiJTaG9vdGluZyBkb3duIHRoZSAiTW9yZSBHdW5zLCBMZXNzIENyaW1lIiBIeXBvdGhlc2lzKioqXShodHRwczovL3d3dy5qc3Rvci5vcmcvc3RhYmxlLzEyMjk2MDM/c2VxPTEpe3RhcmdldD0iX2JsYW5rIn0gCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJEb25vaHVlLnBuZyIpKQpgYGAKClRoaXMgaGFzIGJlZW4gYSBjb250cm92ZXJzaWFsIHRvcGljIGFzIG1hbnkgb3RoZXIgYXJ0aWNsZXMgYWxzbyBoYWQgY29uZmxpY3RpbmcgcmVzdWx0cy4gU2VlIFtoZXJlXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9Nb3JlX0d1bnMsX0xlc3NfQ3JpbWUpe3RhcmdldD0iX2JsYW5rIn0gZm9yIGEgbGlzdCBvZiBzdHVkaWVzLgoKVGhlIFtEb25vaHVlLCBldCBhbC5dKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9IGFydGljbGUgZGlzY3Vzc2VzIGhvdyB0aGVyZSBhcmUgbWFueSBvdGhlciBpbXBvcnRhbnQgbWV0aG9kb2xpY2FsIGFzcGVjdHMgYmVzaWRlcyBtdWx0aWNvbGluZWFyaXR5IHRoYXQgY291bGQgYWNjb3VudCBmb3IgdGhlIGhpc3RvcmljYWxseSBjb25mbGljdGluZyByZXN1bHRzIGluIHRoZXNlIHByZXZpb3VzIHBhcGVycy4KCkluIGZhY3QsIG5lYXJseSBldmVyeSBhc3BlY3Qgb2YgdGhlIGRhdGEgYW5hbHlzaXMgcHJvY2VzcyB3YXMgZGlmZmVyZW50IGJldHdlZW4gdGhlIFtEb25vaHVlLCBldCBhbC5dKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9IGFuYWx5c2lzIGFuZCB0aGUgW0xvdHQgYW5kIE11c3RhcmRdKGh0dHBzOi8vY2hpY2Fnb3VuYm91bmQudWNoaWNhZ28uZWR1L2NnaS92aWV3Y29udGVudC5jZ2k/YXJ0aWNsZT0xMTUwJmNvbnRleHQ9bGF3X2FuZF9lY29ub21pY3Mpe3RhcmdldD0iX2JsYW5rIn0gYW5hbHlzaXMuCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICc3NSUnLCBvdXQud2lkdGggPSAnNzUlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCAiRWR1Y2F0aW9uYWxfR3JhcGhpYzEuanBnIikpCmBgYAoKSG93ZXZlciwgd2Ugd2lsbCBmb2N1cyBwYXJ0aWN1bGFybHkgb24gbXVsdGljb2xpbmVhcml0eSBhbmQgd2Ugd2lsbCBleHBsb3JlIGhvdyBpdCBjYW4gaW5mbHVlbmNlIGxpbmVhciByZWdyZXNzaW9uIGFuYWx5c2VzIGFuZCByZXN1bHQgaW4gZGlmZmVyZW50IGNvbmNsdXNpb25zLiAKClRoaXMgYW5hbHlzaXMgd2lsbCBkZW1vbnN0cmF0ZSBob3cgbWV0aG9kb2xvZ2ljYWwgZGV0YWlscyBjYW4gYmUgY3JpdGljYWxseSBpbmZsdWVudGlhbCBmb3Igb3VyIG92ZXJhbGwgY29uY2x1c2lvbnMgYW5kIGNhbiByZXN1bHQgaW4gaW1wb3J0YW50IHBvbGljeSByZWxhdGVkIGNvbnNlcXVlbmNlcy4gVGhpcyBbYXJ0aWNsZV0oKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9KSB3aWxsIHByb3ZpZGUgYSBiYXNpcyBmb3IgdGhlIG1vdGl2YXRpb24uIAoKIyMjIyB7LnJlZmVyZW5jZV9ibG9ja30KCkpvaG4gSi4gRG9ub2h1ZSBldCBhbC4sIFJpZ2h04oCQdG/igJBDYXJyeSBMYXdzIGFuZCBWaW9sZW50IENyaW1lOiBBIENvbXByZWhlbnNpdmUgQXNzZXNzbWVudCBVc2luZyBQYW5lbCBEYXRhIGFuZCBhIFN0YXRl4oCQTGV2ZWwgU3ludGhldGljIENvbnRyb2wgQW5hbHlzaXMuICpKb3VybmFsIG9mIEVtcGlyaWNhbCBMZWdhbCBTdHVkaWVzKiwgMTYsMiAoMjAxOSkuCgpEYXZpZCBCLiBNdXN0YXJkICYgSm9obiBMb3R0LiBDcmltZSwgRGV0ZXJyZW5jZSwgYW5kIFJpZ2h0LXRvLUNhcnJ5IENvbmNlYWxlZCBIYW5kZ3Vucy4gKkNvYXNlLVNhbmRvciBJbnN0aXR1dGUgZm9yIExhdyAmIEVjb25vbWljcyogV29ya2luZyBQYXBlciBOby4gNDEsICgxOTk2KS4KCiMjIyMKCgpIZXJlIHlvdSBjYW4gc2VlIHRoZSBkaWZmZXJlbmNlcyBpbiB0aGUgZGF0YSB1c2VkIGluIHRoZSBmZWF0dXJlZCBSVEMgYXJ0aWNsZXM6CgoKYGBge3IsIGVjaG89RkFMU0UsIG91dC5oZWlnaHQgPSAnMTAwJScsIG91dC53aWR0aCA9ICcxMDAlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCdEb25vaHVlX1RhYmxlMi5wbmcnKSkKYGBgCgoKV2Ugd2lsbCBwZXJmb3JtIGFuYWx5c2VzIHNpbWlsYXIgdG8gdGhvc2UgaW4gdGhlc2UgYXJ0aWNsZXMsIGhvd2V2ZXIgKip3ZSB3aWxsIG5vdCB0cnkgdG8gcmVjcmVhdGUgdGhlbSoqLCBpbnN0ZWFkIHdlIHdpbGwgc2ltcGxpZnkgb3VyIGFuYWx5c2lzIHRvIGFsbG93IHVzIHRvIGZvY3VzIG9uIG11bHRpY29saW5lYXJpdHkuCgoKVGhlcmVmb3JlIHdlIHdpbGwgdXNlIGEgc3Vic2V0IG9mIHRoZSBsaXN0ZWQgZXhwbGFuYXRvcnkgdmFyaWFibGVzIGFuZCB0aGV5IHdpbGwgYmUgY29uc2lzdGVudCBmb3IgYm90aCBhbmFseXNlcyB0aGF0IHdlIHdpbGwgcGVyZm9ybSwgd2l0aCB0aGUgZXhjZXB0aW9uIHRoYXQgb25lIGFuYWx5c2lzIHdpbGwgaGF2ZSA2IGRlbW9ncmFwaGljIHZhcmlhYmxlcyBsaWtlIHRoZSBhbmFseXNpcyBpbiB0aGUgW0Rvbm9odWUsIGV0IGFsLl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpe3RhcmdldD0iX2JsYW5rIn0gYXJ0aWNsZSBhbmQgdGhlIG90aGVyIHdpbGwgaGF2ZSAzNiBkZW1vZ3JwYWhpYyB2YXJpYWJsZXMgbGlrZSB0aGUgYW5hbHlzaXMgaW4gdGhlIFtMb3R0IGFuZCBNdXN0YXJkXShodHRwczovL2NoaWNhZ291bmJvdW5kLnVjaGljYWdvLmVkdS9jZ2kvdmlld2NvbnRlbnQuY2dpP2FydGljbGU9MTE1MCZjb250ZXh0PWxhd19hbmRfZWNvbm9taWNzKXt0YXJnZXQ9Il9ibGFuayJ9IGFydGljbGUuCgoKIyAqKk1haW4gUXVlc3Rpb24qKgoqKiogCgojIyMjIHsubWFpbl9xdWVzdGlvbl9ibG9ja30KPGI+PHU+IE91ciBtYWluIHF1ZXN0aW9uOiA8L3U+PC9iPgoKMSkgSG93IGRvZXMgdGhlIGluY2x1c2lvbiBvZiBkaWZmZXJlbnQgbnVtYmVycyBvZiBhZ2UgZ3JvdXBzIGluZmx1ZW5jZSB0aGUgcmVzdWx0cyBvZiBhbiBhbmFseXNpcyBvZiByaWdodCB0byBjYXJyeSBsYXdzIGFuZCB2aW9sZW5jZSByYXRlcz8KCiMjIyMKCgoKIyAqKkxlYXJuaW5nIE9iamVjdGl2ZXMqKiAKKioqIAoKPHU+KipTdGF0aXN0aWNhbCBMZWFybmluZyBPYmplY3RpdmVzOioqPC91PiAKCjEpIHdoYXQgbXVsdGljb2xsaW5lYXJpdHkgaXMgYW5kIGhvdyBpdCBjYW4gaW5mbHVlbmNlIGxpbmVhciByZWdyZXNzaW9uIGNvZWZmaWNpZW50cyAgCjIpIGhvdyB0byBsb29rIGZvciB0aGUgcHJlc2VuY2Ugb2YgbXVsdGljb2xsaW5hcml0eSBhbmQgZGV0ZXJtaW5lIHRoZSBzZXZlcml0eQozKSB0aGUgZGlmZmVyZW5jZSBiZXR3ZWVuIG11bHRpY29sbGluZWFyaXR5IGFuZCBjb3JyZWxhdGlvbiAKCgo8dT4qKkRhdGEgc2NpZW5jZSBMZWFybmluZyBPYmplY3RpdmVzOioqPC91PgoKMSkgZGF0YSBpbXBvcnQgb2YgbWFueSBkaWZmZXJlbnQgZmlsZSB0eXBlcyB3aXRoIHNwZWNpYWwgY2FzZXMgKGByZWFkcmAsIGByZWFkeGxgLCBgcGRmdG9vbHNgKQoyKSBqb2luaW5nIGRhdGEgZnJvbSBtdWx0aXBsZSBzb3VyY2VzIChgZHBseXJgKSAgCjMpIHdvcmtpbmcgd2l0aCBjaGFyYWN0ZXIgc3RyaW5ncyAoYHN0cmluZ3JgKQo0KSBkYXRhIGNvbXBhcmlzb25zIChgZHBseXJgIGFuZCBgamFuaXRvcmApCjUpIHJlc2hhcGluZyBkYXRhIGludG8gZGlmZmVyZW50IGZvcm1hdHMgKGB0aWR5cmApICAKNikgdmlzdWFsaXphdGlvbnMgKGBnZ3Bsb3QyYCkgCjcpIHBlcmZvcm0gaXRlcmF0aXZlIHNpbXVsYXRpb25zIChgcnNhbXBsZWApCgoKCldlIHdpbGwgZXNwZWNpYWxseSBmb2N1cyBvbiB1c2luZyBwYWNrYWdlcyBhbmQgZnVuY3Rpb25zIGZyb20gdGhlIFtgVGlkeXZlcnNlYF0oaHR0cHM6Ly93d3cudGlkeXZlcnNlLm9yZy8pe3RhcmdldD0iX2JsYW5rIn0sIHN1Y2ggYXMgYGRwbHlyYCBhbmQgYGdncGxvdDJgLiBUaGUgdGlkeXZlcnNlIGlzIGEgbGlicmFyeSBvZiBwYWNrYWdlcyBjcmVhdGVkIGJ5IFJTdHVkaW8uIFdoaWxlIHNvbWUgc3R1ZGVudHMgbWF5IGJlIGZhbWlsaWFyIHdpdGggcHJldmlvdXMgUiBwcm9ncmFtbWluZyBwYWNrYWdlcywgdGhlc2UgcGFja2FnZXMgbWFrZSBkYXRhIHNjaWVuY2UgaW4gUiBlc3BlY2lhbGx5IGVmZmljaWVudC4KCgpgYGB7ciwgb3V0LndpZHRoID0gIjIwJSIsIGVjaG8gPSBGQUxTRSwgZmlnLmFsaWduID0iY2VudGVyIn0KaW5jbHVkZV9ncmFwaGljcygiaHR0cHM6Ly90aWR5dmVyc2UudGlkeXZlcnNlLm9yZy9sb2dvLnBuZyIpCmBgYAoKIyAqKkNvbnRleHQqKgoqKioKClNvIHdoYXQgZXhhY3RseSBpcyBhICoqcmlnaHQtdG8tY2FycnkgbGF3Kio/CgpJdCBpcyBhIGxhdyB0aGF0c3BlY2lmaWVzIGlmIGFuZCBob3cgY2l0aXplbnMgYXJlIGFsbG93ZWQgdG8gaGF2ZSBhIGZpcmVhcm0gb24gdGhlaXIgcGVyc29uIG9yIG5lYXJieSAoZm9yIGV4YW1wbGUgaW4gdGhlIGNpdGl6ZW4ncyBjYXIpIGluIHB1YmxpYy4gCgpUaGUgW1NlY29uZCBBbWVuZG1lbnRdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL1NlY29uZF9BbWVuZG1lbnRfdG9fdGhlX1VuaXRlZF9TdGF0ZXNfQ29uc3RpdHV0aW9uKXt0YXJnZXQ9Il9ibGFuayJ9IHRvIHRoZSBVbml0ZWQgU3RhdGVzIENvbnN0aXR1dGlvbiBndWFyYW50ZWVzIHRoZSByaWdodCB0byAia2VlcCBhbmQgYmVhciBhcm1zIi4gVGhlIGFtZW5kbWVudCB3YXMgcmF0aWZpZWQgaW4gMTc5MSBhcyBwYXJ0IG9mIHRoZSBbQmlsbCBvZiBSaWdodHNdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL1VuaXRlZF9TdGF0ZXNfQmlsbF9vZl9SaWdodHMpe3RhcmdldD0iX2JsYW5rIn0uCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICc1MCUnLCBvdXQud2lkdGggPSAnNTAlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcygiaHR0cHM6Ly91cGxvYWQud2lraW1lZGlhLm9yZy93aWtpcGVkaWEvY29tbW9ucy83Lzc5L0JpbGxfb2ZfUmlnaHRzX1BnMW9mMV9BQy5qcGciKQpgYGAKCkhvd2V2ZXIsIHRoZXJlIGFyZSBubyBmZWRlcmFsIGxhd3MgYWJvdXQgY2FycnlpbmcgZmlyZWFybXMgaW4gcHVibGljLiAKClRoZXNlIGxhd3MgYXJlIGNyZWF0ZWQgYW5kIGVuZm9yY2VkIGF0IHRoZSBzdGF0ZSBsZXZlbC4gU2F0ZXMgdmFyeSBncmVhdGx5IGluIHRoZWlyIGxhd3MgYWJvdXQgdGhlIHJpZ2h0IHRvIGNhcnJ5IGZpcmVhcm1zLiBTb21lIHJlcXVpcmUgZXh0ZW5zaXZlIGVmZm9ydCB0byBvYnRhaW4gYSBwZXJtaXQgdG8gbGVnYWxseSBjYXJyeSBhIGZpcmVhcm0sIHdoaWxlIG90aGVyIHN0YXRlcyByZXF1aXJlIHZlcnkgbWluaW1hbCBlZmZvcnQgdG8gbGVnYWxseSBjYXJyeSBhIGZpcmVhcm0uCgoKQWNjb3JkaW5nIHRvIFdpa2lwZWRpYSBhYm91dCB0aGUgaGlzdG9yeSBvZiByaWdodC10by1jYXJyeSBwb2xpY2llcyBpbiB0aGUgVW5pdGVkIFN0YXRlczoKCj4gUHVibGljIHBlcmNlcHRpb24gb24gY29uY2VhbGVkIGNhcnJ5IHZzIG9wZW4gY2FycnkgaGFzIGxhcmdlbHkgZmxpcHBlZC4gSW4gdGhlIGVhcmx5IGRheXMgb2YgdGhlIFVuaXRlZCBTdGF0ZXMsIG9wZW4gY2Fycnlpbmcgb2YgZmlyZWFybXMsIGxvbmcgZ3VucyBhbmQgcmV2b2x2ZXJzIHdhcyBhIGNvbW1vbiBhbmQgd2VsbC1hY2NlcHRlZCBwcmFjdGljZS4gU2VlaW5nIGd1bnMgY2FycmllZCBvcGVubHkgd2FzIG5vdCBjb25zaWRlcmVkIHRvIGJlIGFueSBjYXVzZSBmb3IgYWxhcm0uIFRoZXJlZm9yZSwgYW55b25lIHdobyB3b3VsZCBjYXJyeSBhIGZpcmVhcm0gYnV0IGF0dGVtcHQgdG8gY29uY2VhbCBpdCB3YXMgY29uc2lkZXJlZCB0byBoYXZlIHNvbWV0aGluZyB0byBoaWRlLCBhbmQgcHJlc3VtZWQgdG8gYmUgYSBjcmltaW5hbC4gRm9yIHRoaXMgcmVhc29uLCBjb25jZWFsZWQgY2Fycnkgd2FzIGRlbm91bmNlZCBhcyBhIGRldGVzdGFibGUgcHJhY3RpY2UgaW4gdGhlIGVhcmx5IGRheXMgb2YgdGhlIFVuaXRlZCBTdGF0ZXMuCgo+IENvbmNlYWxlZCB3ZWFwb25zIGJhbnMgd2VyZSBwYXNzZWQgaW4gS2VudHVja3kgYW5kIExvdWlzaWFuYSBpbiAxODEzLiAoSW4gdGhvc2UgZGF5cyBvcGVuIGNhcnJ5IG9mIHdlYXBvbnMgZm9yIHNlbGYtZGVmZW5zZSB3YXMgY29uc2lkZXJlZCBhY2NlcHRhYmxlOyBjb25jZWFsZWQgY2Fycnkgd2FzIGRlbm91bmNlZCBhcyB0aGUgcHJhY3RpY2Ugb2YgY3JpbWluYWxzLikgQnkgMTg1OSwgSW5kaWFuYSwgVGVubmVzc2VlLCBWaXJnaW5pYSwgQWxhYmFtYSwgYW5kIE9oaW8gaGFkIGZvbGxvd2VkIHN1aXQuIEJ5IHRoZSBlbmQgb2YgdGhlIG5pbmV0ZWVudGggY2VudHVyeSwgc2ltaWxhciBsYXdzIHdlcmUgcGFzc2VkIGluIHBsYWNlcyBzdWNoIGFzIFRleGFzLCBGbG9yaWRhLCBhbmQgT2tsYWhvbWEsIHdoaWNoIHByb3RlY3RlZCBzb21lIGd1biByaWdodHMgaW4gdGhlaXIgc3RhdGUgY29uc3RpdHV0aW9ucy4gQmVmb3JlIHRoZSBtaWQgMTkwMHMsIG1vc3QgVS5TLiBzdGF0ZXMgaGFkIHBhc3NlZCBjb25jZWFsZWQgY2FycnkgbGF3cyByYXRoZXIgdGhhbiBiYW5uaW5nIHdlYXBvbnMgY29tcGxldGVseS4gVW50aWwgdGhlIGxhdGUgMTk5MHMsIG1hbnkgU291dGhlcm4gc3RhdGVzIHdlcmUgZWl0aGVyICJOby1Jc3N1ZSIgb3IgIlJlc3RyaWN0aXZlIE1heS1Jc3N1ZSIuIFNpbmNlIHRoZW4sIHRoZXNlIHN0YXRlcyBoYXZlIGxhcmdlbHkgZW5hY3RlZCAiU2hhbGwtSXNzdWUiIGxpY2Vuc2luZyBsYXdzLCB3aXRoIG51bWVyb3VzIHN0YXRlcyBsZWdhbGl6aW5nICJVbnJlc3RyaWN0ZWQgY29uY2VhbGVkIGNhcnJ5Ii4KClNlZSBbaGVyZV0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvSGlzdG9yeV9vZl9jb25jZWFsZWRfY2FycnlfaW5fdGhlX1UuUy4pe3RhcmdldD0iX2JsYW5rIn0gZm9yIG1vcmUgaW5mb3JtYXRpb24uCgpIZXJlIGFyZSB0aGUgZ2VuZXJhbCBjYXRlZ29yaWVzIG9mIFJpZ2h0IHRvIENhcnJ5IExhd3M6CgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJSVEMucG5nIikpCmBgYApbc291cmNlXShodHRwczovL3d3dy5ucmFpbGEub3JnL2d1bi1sYXdzLyl7dGFyZ2V0PSJfYmxhbmsifQoKCmBgYHtyLCBlY2hvPUZBTFNFLCBvdXQuaGVpZ2h0ID0gJzEwMCUnLCBvdXQud2lkdGggPSAnMTAwJScsIGZpZy5hbGlnbj0nY2VudGVyJ30Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoaGVyZSgiaW1nIiwgIlJUQ19tYXAucG5nIikpCmBgYAoKW3NvdXJjZV0oaHR0cHM6Ly93d3cubnJhaWxhLm9yZy9ndW4tbGF3cy8pe3RhcmdldD0iX2JsYW5rIn0KCllvdSBjYW4gc2VlIHRoYXQgbm9uZSBvZiB0aGUgZmlmdHkgc3RhdGVzIGhhdmUgbm8taXNzdWUgbGF3cyBjdXJyZW50bHkgKHRoZSBncmF5IGNhdGVnb3J5KSwgbWVhbmluZyB0aGF0IGFsbCBzdGF0ZXMgYWxsb3cgdGhlIHJpZ2h0IHRvIGNhcnJ5IGZpcmVhcm1zIGF0IGxlYXN0IGluIHNvbWUgd2F5LCBob3dldmVyIHRoZSBsZXZlbCBvZiByZXN0cmljdGlvbnMgaXMgZHJhbWF0aWNhbGx5IGRpZmZlcmVudCBmcm9tIG9uZSBzdGF0ZSB0byBhbm90aGVyLgoKSGVyZSB5b3UgY2FuIHNlZSBob3cgdGhlc2UgbGF3cyBoYXZlIGNoYW5nZWQgb3ZlciB0aW1lIGFyb3VuZCB0aGUgY291bnRyeToKYGBge3IsIGVjaG89RkFMU0UsIG91dC5oZWlnaHQgPSAnMTAwJScsIG91dC53aWR0aCA9ICcxMDAlJywgZmlnLmFsaWduPSdjZW50ZXInfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcygiaHR0cHM6Ly91cGxvYWQud2lraW1lZGlhLm9yZy93aWtpcGVkaWEvY29tbW9ucy90aHVtYi81LzVhL1JpZ2h0X3RvX0NhcnJ5JTJDX3RpbWVsaW5lLmdpZi82MjBweC1SaWdodF90b19DYXJyeSUyQ190aW1lbGluZS5naWYiKQpgYGAKClRoZXJlIGlzIHZhcmlhdGlvbiBmcm9tIHN0YXRlIHRvIHN0YXRlIGV2ZW4gd2l0aGluIHRoZSBzYW1lIGdlbmVyYWwgY2F0ZWdvcnk6CgpGb3IgZXhhbXBsZSBoZXJlIGFyZSB0aGUgW2N1cnJlbnQgY2FycnkgbGF3cyBpbiBJZGFob10oaHR0cHM6Ly93d3cubnJhaWxhLm9yZy9ndW4tbGF3cy9zdGF0ZS1ndW4tbGF3cy9pZGFoby8pIHdoaWNoIGlzIGNvbnNpZGVyZWQgYW4gIlVucmVzdHJpY3RlZCAtIG5vIHBlcm1pdCByZXF1aXJlZCIgc3RhdGU6Cgo+SWRhaG8gcGVybWl0cyB0aGUgb3BlbiBjYXJyeWluZyBvZiBmaXJlYXJtcy4KCj5JZGFobyBsYXcgcGVybWl0cyBib3RoIHJlc2lkZW50cyBhbmQgbm9uLXJlc2lkZW50cyB3aG8gYXJlIGF0IGxlYXN0IDE4IHllYXJzIG9sZCB0byBjYXJyeSBjb25jZWFsZWQgd2VhcG9ucywgd2l0aG91dCBhIGNhcnJ5IGxpY2Vuc2UsIG91dHNpZGUgdGhlIGxpbWl0cyBvZiBvciBjb25maW5lcyBvZiBhbnkgY2l0eSwgcHJvdmlkZWQgdGhlIHBlcnNvbiBpcyBub3Qgb3RoZXJ3aXNlIGRpc3F1YWxpZmllZCBmcm9tIGJlaW5nIGlzc3VlZCBhIGxpY2Vuc2UgdG8gY2FycnkuCgo+QSBwZXJzb24gbWF5IGFsc28gY2FycnkgY29uY2VhbGVkIHdlYXBvbnMgb24gb3IgYWJvdXQgaGlzIG9yIGhlciBwZXJzb24sIHdpdGhvdXQgYSBsaWNlbnNlLCBpbiB0aGUgcGVyc29u4oCZcyBvd24gcGxhY2Ugb2YgYWJvZGUgb3IgZml4ZWQgcGxhY2Ugb2YgYnVzaW5lc3MsIG9uIHByb3BlcnR5IGluIHdoaWNoIHRoZSBwZXJzb24gaGFzIGFueSBvd25lcnNoaXAgb3IgbGVhc2Vob2xkIGludGVyZXN0LCBvciBvbiBwcml2YXRlIHByb3BlcnR5IHdoZXJlIHRoZSBwZXJzb24gaGFzIHBlcm1pc3Npb24gdG8gY2FycnkgZnJvbSBhbnkgcGVyc29uIHdobyBoYXMgYW4gb3duZXJzaGlwIG9yIGxlYXNlaG9sZCBpbnRlcmVzdCBpbiB0aGF0IHByb3BlcnR5LiAKCj5TdGF0ZSBsYXcgYWxzbyBhbGxvd3MgYW55IHJlc2lkZW50IG9mIElkYWhvIG9yIGEgY3VycmVudCBtZW1iZXIgb2YgdGhlIGFybWVkIGZvcmNlcyBvZiB0aGUgVW5pdGVkIFN0YXRlcyB0byBjYXJyeSBhIGNvbmNlYWxlZCBoYW5kZ3VuIHdpdGhvdXQgYSBsaWNlbnNlIHRvIGNhcnJ5LCBwcm92aWRlZCB0aGUgcGVyc29uIGlzIG92ZXIgMTggeWVhcnMgb2xkIGFuZCBub3QgZGlzcXVhbGlmaWVkIGZyb20gYmVpbmcgaXNzdWVkIGEgbGljZW5zZSB0byBjYXJyeSBjb25jZWFsZWQgd2VhcG9ucyB1bmRlciBzdGF0ZSBsYXcuIEFuIGFtZW5kbWVudCB0byBzdGF0ZSBsYXcgdGhhdCB0YWtlcyBlZmZlY3Qgb24gSnVseSAxLCAyMDIwIGNoYW5nZXMgdGhlIHJlZmVyZW5jZSBpbiB0aGUgYWJvdmUgbGF3IGZyb20g4oCcYSByZXNpZGVudCBvZiBJZGFob+KAnSB0byDigJxhbnkgY2l0aXplbiBvZiB0aGUgVW5pdGVkIFN0YXRlcy7igJ0gIAoKCkFuZCBoZXJlIGFyZSB0aGUgW2N1cnJlbnQgY2FycnkgbGF3cyBpbiBBcml6b25hXShodHRwczovL3d3dy5ucmFpbGEub3JnL2d1bi1sYXdzL3N0YXRlLWd1bi1sYXdzL2FyaXpvbmEvKSB3aGljaCBpcyBhbHNvIGNvbnNpZGVyZWQgYW4gIlVucmVzdHJpY3RlZCAtIG5vIHBlcm1pdCByZXF1aXJlZCIgc3RhdGU6Cgo+IEFyaXpvbmEgcmVzcGVjdHMgdGhlIHJpZ2h0IG9mIGxhdyBhYmlkaW5nIGNpdGl6ZW5zIHRvIG9wZW5seSBjYXJyeSBhIGhhbmRndW4uCgo+IEFueSBwZXJzb24gMjEgeWVhcnMgb2YgYWdlIG9yIG9sZGVyLCB3aG8gaXMgbm90IHByb2hpYml0ZWQgcG9zc2Vzc29yLCBtYXkgY2FycnkgYSB3ZWFwb24gb3Blbmx5IG9yIGNvbmNlYWxlZCB3aXRob3V0IHRoZSBuZWVkIGZvciBhIGxpY2Vuc2UuIEFueSBwZXJzb24gY2Fycnlpbmcgd2l0aG91dCBhIGxpY2Vuc2UgbXVzdCBhY2tub3dsZWRnZSBhbmQgY29tcGx5IHdpdGggdGhlIGRlbWFuZHMgb2YgYSBsYXcgZW5mb3JjZW1lbnQgb2ZmaWNlciB3aGVuIGFza2VkIGlmIGhlL3NoZSBpcyBjYXJyeWluZyBhIGNvbmNlYWxlZCBkZWFkbHkgd2VhcG9uLCBpZiB0aGUgb2ZmaWNlciBoYXMgaW5pdGlhdGVkIGFuICJpbnZlc3RpZ2F0aW9uIiBzdWNoIGFzIGEgdHJhZmZpYyBzdG9wLgoKTm90aWNlIHRoYXQgY2l0aXplbnMgaW4gSWRhaG8gb25seSBuZWVkIHRvIGJlIDE4IHRvIGNhcnJ5IGEgZmlyZWFybSwgd2hlcmVhcyB0aGV5IG11c3QgYmUgMjEgaW4gQXJpem9uYS4gCgoKSW4gY29udHJhc3QgaGVyZSBpcyBhbiBleGFtcGxlIG9mIFtjdXJyZW50IGNhcnJ5IGxhd3MgaW4gTWFyeWxhbmRdKGh0dHBzOi8vd3d3Lm5yYWlsYS5vcmcvZ3VuLWxhd3Mvc3RhdGUtZ3VuLWxhd3MvbWFyeWxhbmQvKSB3aGljaCBpcyBjb25zaWRlcmVkIGEgIlJpZ2h0cyBSZXN0cmljdGVkLVZlcnkgTGltaXRlZCBJc3N1ZSIgc3RhdGU6Cgo+IENhcnJ5aW5nIGFuZCBUcmFuc3BvcnRhdGlvbiBpbiBWZWhpY2xlcwpJdCBpcyB1bmxhd2Z1bCBmb3IgYW55IHBlcnNvbiB3aXRob3V0IGEgcGVybWl0IHRvIHdlYXIgb3IgY2FycnkgYSBoYW5kZ3VuLCBvcGVubHkgb3IgY29uY2VhbGVkLCB1cG9uIG9yIGFib3V0IGhpcyBwZXJzb24uICBJdCBpcyBhbHNvIHVubGF3ZnVsIGZvciBhbnkgcGVyc29uIHRvIGtub3dpbmdseSB0cmFuc3BvcnQgYSBoYW5kZ3VuIGluIGFueSB2ZWhpY2xlIHRyYXZlbGluZyBvbiBwdWJsaWMgcm9hZHMsIGhpZ2h3YXlzLCB3YXRlcndheXMgb3IgYWlyd2F5cywgb3IgdXBvbiByb2FkcyBvciBwYXJraW5nIGxvdHMgZ2VuZXJhbGx5IHVzZWQgYnkgdGhlIHB1YmxpYy4gVGhpcyBkb2VzIG5vdCBhcHBseSB0byBhbnkgcGVyc29uIHdlYXJpbmcsIGNhcnJ5aW5nIG9yIHRyYW5zcG9ydGluZyBhIGhhbmRndW4gd2l0aGluIHRoZSBjb25maW5lcyBvZiByZWFsIGVzdGF0ZSBvd25lZCBvciBsZWFzZWQgYnkgaGltLCBvciBvbiB3aGljaCBoZSByZXNpZGVzLCBvciB3aXRoaW4gdGhlIGNvbmZpbmVzIG9mIGEgYnVzaW5lc3MgZXN0YWJsaXNobWVudCBvd25lZCBvciBsZWFzZWQgYnkgaGltLgoKPiBQZXJtaXQgVG8gQ2FycnkKQXBwbGljYXRpb24gZm9yIGEgcGVybWl0IHRvIGNhcnJ5IGEgaGFuZGd1biBpcyBtYWRlIHRvIHRoZSBTZWNyZXRhcnkgb2YgU3RhdGUgUG9saWNlLiBJbiBhZGRpdGlvbiB0byB0aGUgcHJpbnRlZCBhcHBsaWNhdGlvbiBmb3JtLCB0aGUgYXBwbGljYW50IHNob3VsZCBzdWJtaXQgYSBub3Rhcml6ZWQgbGV0dGVyIHN0YXRpbmcgdGhlIHJlYXNvbnMgd2h5IGhlIGlzIGFwcGx5aW5nIGZvciBhIHBlcm1pdC4KCgphdm9jYWRvLi4uLlJpZ2h0IHRvIGNhcnJ5IGFuZCBjb3ZpZCBtYXNrcz8KCiMgKipMaW1pdGF0aW9ucyoqCioqKiAKVGhlcmUgYXJlIHNvbWUgaW1wb3J0YW50IGNvbnNpZGVyYXRpb25zIHJlZ2FyZGluZyB0aGlzIGRhdGEgYW5hbHlzaXMgdG8ga2VlcCBpbiBtaW5kOiAKCjEpIFdlIGRvIG5vdCB1c2UgYWxsIG9mIHRoZSBkYXRhIHVzZWQgYnkgZWl0aGVyIHRoZSBbTG90dCBhbmQgTXVzdGFyZF0oaHR0cHM6Ly9jaGljYWdvdW5ib3VuZC51Y2hpY2Fnby5lZHUvY2dpL3ZpZXdjb250ZW50LmNnaT9hcnRpY2xlPTExNTAmY29udGV4dD1sYXdfYW5kX2Vjb25vbWljcyl7dGFyZ2V0PSJfYmxhbmsifSBvciBbRG9ub2h1ZSwgZXQgYWwuXShodHRwczovL3d3dy5uYmVyLm9yZy9wYXBlcnMvdzIzNTEwLnBkZil7dGFyZ2V0PSJfYmxhbmsifSBhbmFseXNlcywgbm9yIGRvIHdlIHBlcmZvcm0gdGhlIHNhbWUgYW5hbHlzaXMgb2YgZWFjaCBhcnRpY2xlLiBXZSBpbnN0ZWFkIHBlcmZvcm0gYSBtdWNoIHNpbXBsZXIgYW5hbHlzaXMgd2l0aCBsZXNzIHZhcmlhYmxlcyBmb3IgdGhlIHB1cnBvc2VzIG9mIGlsbHVzdHJhdGlvbiBvZiB0aGUgY29uY2VwdCBvZiBtdWx0aWNvbGxpbmVhcml0eSBhbmQgaXRzIGluZmx1ZW5jZSBvbiByZWdyZXNzaW9uIGNvZWZmaWNpZW50cywgbm90IHRvIHJlcHJvZHVjZSBlaXRoZXIgYW5hbHlzaXMuCgoyKSBPdXIgYW5hbHlzaXMgYWNjb3VudHMgZm9yIGVpdGhlciB0aGUgYWRvcHRpb24gb3IgbGFjayBvZiBhZG9wdGlvbiBvZiBhIHBlcm1pc3NpdmUgcmlnaHQtdG8tY2FycnkgbGF3IGluIGVhY2ggc3RhdGUsIGJ1dCBkb2VzIG5vdCBhY291bnQgZm9yIGRpZmZlcmVuY2VzIGluIHRoZSBsZXZlbCBvZiBwZXJtaXNzaXZlbmVzcyBvZiB0aGUgbGF3cy4KClJlY2FsbCB0aGF0IHRoZXNlIGFyZSB0aGUgY2F0ZWdvcmllcyBvZiByaWdodCB0byBjYXJyeSBsYXdzOgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJSVEMucG5nIikpCmBgYApgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJSVENfbWFwLnBuZyIpKQpgYGAKU3RhdGVzIHdpdGggbGF3cyBvZiB0aGUgY2F0ZWdvcnkgcmlnaHRzIHJlc3RyaWN0ZWQgLSB2ZXJ5IGxpbWl0ZWQgaXNzdWUgKHJlZCkgYXJlIGNvbnNpZGVyZWQgYXMgbm90IGhhdmluZyBhIHBlcm1pc3NpdmUgcmlnaHQtdG8tY2FycnkgbGF3LiBSZWNhbGwgdGhhdCBubyBzdGF0ZXMgY3VycmVudGx5IGhhdmUgYSByaWdodHMgaW5mcmluZ2VkL25vbi1pc3N1ZSBsYXcuCgpTdGF0ZXMgb2YgYWxsIG90aGVyIGNhdGVnb3JpZXMgKHNoYWxsIGlzc3VlLCBkaXNjcmV0aW9uYXJ5L3JlYXNvbmFibGUgaXNzdWUsIGFuZCBubyBwZXJtaXQgcmVxdWlyZWQpIChhbGwgc2hhZGVzIG9mIGJsdWUpIGFyZSBjb25zaWRlcmVkIHRoZSBzYW1lIGluIG91ciBhbmFseXNpcywgYXMgaGF2aW5nIGEgcGVybWlzc2l2ZSByaWdodC10by1jYXJyeSBsYXcuCgozKSBCZWNhdXNlIG91ciBhbmFseXNpcyBpcyBhbiBvdmVyc2ltcGxpZmljYXRpb24sIG91ciBhbmFseXNpcyBzaG91bGQgbm90IGJlIHVzZWQgZm9yIGRldGVybWluaW5nIHBvbGljeSBjaGFuZ2VzLCBpbnN0ZWFkIHdlIHN1Z2dlc3QgdGhhdCB1c2VycyBjb25zdWx0IHdpdGggYSBzcGVjaWFsaXN0LgoKCldlIHdvdWxkIGFsc28gbGlrZSB0byBub3RlIHRoYXQuLi5BVk9DQURPCkl0IGlzIGltcG9ydGFudCB0aGF0IHdlIGRvIG5vdCB0cmVhdCByYWNlIGFzIGFuIG9iamVjdGl2ZSBtZWFzdXJlLiBEZXNwaXRlIHRoaXMsIGl0IGNhbiBiZSB1c2VkIHRvIGFkdmFuY2Ugc2NpZW50aWZpYyBpbnF1aXJ5LiBGb3IgbW9yZSBpbmZvcm1hdGlvbiBvbiB0aGlzIHRvcGljLCB3ZSBoYXZlIGluY2x1ZGVkIGEgbGluayB0byBhIFtwYXBlciBvbiB0aGUgdXNlIG9mIHJhY2UgYXMgYSBtZWFzdXJlIGluIGVwaWRlbWlvbG9neV0oaHR0cHM6Ly9hY2FkZW1pYy5vdXAuY29tL2VwaXJldi9hcnRpY2xlLzIyLzIvMTg3LzQ1Njk0MikuIAoKCldlIHdpbGwgYmVnaW4gYnkgbG9hZGluZyB0aGUgcGFja2FnZXMgdGhhdCB3ZSB3aWxsIG5lZWQ6CgpgYGB7cn0KbGlicmFyeShoZXJlKQpsaWJyYXJ5KHJlYWR4bCkKbGlicmFyeShyZWFkcikKbGlicmFyeShwZGZ0b29scykKbGlicmFyeShkcGx5cikKbGlicmFyeShtYWdyaXR0cikKbGlicmFyeSh0aWR5cikKbGlicmFyeShzdHJpbmdyKQpsaWJyYXJ5KHB1cnJyKQpsaWJyYXJ5KGZvcmNhdHMpCmxpYnJhcnkodGliYmxlKQpsaWJyYXJ5KGNhcikgIyB2aWYgZnVuY3Rpb24KbGlicmFyeShwbG0pICMgZml4ZWQgZWZmZWN0IG1vZGVsLCBsaW5lYXIgcmVncmVzc2lvbgpsaWJyYXJ5KGJyb29tKSAjIHRpZHkgb3V0cHV0CmxpYnJhcnkoY293cGxvdCkgIyB0byBwcm9kdWNlIHBsb3Qgb2YgcGxvdHMgCmxpYnJhcnkoR0dhbGx5KQpsaWJyYXJ5KGdncmVwZWwpCmxpYnJhcnkoc2NhbGVzKQpsaWJyYXJ5KGxhdGV4MmV4cCkKbGlicmFyeSh2aXJpZGlzKQpsaWJyYXJ5KGdnY29ycnBsb3QpCmxpYnJhcnkocnNhbXBsZSkKCnNldC5zZWVkKDk5OSkKYGBgCgoKIFBhY2thZ2UgICB8IFVzZSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAKLS0tLS0tLS0tLSB8LS0tLS0tLS0tLS0tLQpbaGVyZV0oaHR0cHM6Ly9naXRodWIuY29tL2plbm55YmMvaGVyZV9oZXJlKXt0YXJnZXQ9Il9ibGFuayJ9ICAgICAgIHwgdG8gZWFzaWx5IGxvYWQgYW5kIHNhdmUgZGF0YQpbcmVhZHJdKGh0dHBzOi8vcmVhZHIudGlkeXZlcnNlLm9yZy8pe3RhcmdldD0iX2JsYW5rIn0gICAgICB8IHRvIGltcG9ydCB0aGUgQ1NWIGZpbGUgZGF0YQpbY2FyXSAgfCB0byBjYWxjdWxhdGUgdmlmIHZhbHVlcwpbcHVycnJdIHwgdG8gY29tYmluZSBtdWx0aXBsZSB0aWJibGVzIHdpdGhpbiBhIGxpc3Qgb2YgdGliYmxlcwpbZm9yY2F0c10gfCB0byBjb2xsYXBzZSBsZXZlbHMgb2YgZmFjdG9ycyBpbnRvIG1vcmUgc3VtbWFyaXNlZCB2ZXJzaW9ucwpUaGUgZmlyc3QgdGltZSB3ZSB1c2UgYSBmdW5jdGlvbiwgd2Ugd2lsbCB1c2UgdGhlIGA6OmAgdG8gaW5kaWNhdGUgd2hpY2ggcGFja2FnZSB3ZSBhcmUgdXNpbmcuIFVubGVzcyB3ZSBoYXZlIG92ZXJsYXBwaW5nIGZ1bmN0aW9uIG5hbWVzLCB0aGlzIGlzIG5vdCBuZWNlc3NhcnksIGJ1dCB3ZSB3aWxsIGluY2x1ZGUgaXQgaGVyZSB0byBiZSBpbmZvcm1hdGl2ZSBhYm91dCB3aGVyZSB0aGUgZnVuY3Rpb25zIHdlIHdpbGwgdXNlIGNvbWUgZnJvbS4KCgojICoqV2hhdCBhcmUgdGhlIGRhdGE/KioKKioqCgpCZWxvdyBpcyBhIHRhYmxlIGZyb20gdGhlIFtEb25vaHVlLCBldCBhbC5dKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9IHBhcGVyIHRoYXQgc2hvd3MgdGhlIGRhdGEgdXNlZCBpbiBib3RoIGFuYWx5c2VzLCB3aGVyZSBEQVcgc3RhbmRzIGZvciBbRG9ub2h1ZSwgZXQgYWwuXShodHRwczovL3d3dy5uYmVyLm9yZy9wYXBlcnMvdzIzNTEwLnBkZil7dGFyZ2V0PSJfYmxhbmsifSBhbmQgTE0gc3RhbmRzIGZvciBbTG90dCBhbmQgTXVzdGFyZF0oaHR0cHM6Ly9jaGljYWdvdW5ib3VuZC51Y2hpY2Fnby5lZHUvY2dpL3ZpZXdjb250ZW50LmNnaT9hcnRpY2xlPTExNTAmY29udGV4dD1sYXdfYW5kX2Vjb25vbWljcyl7dGFyZ2V0PSJfYmxhbmsifS4KCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJEb25vaHVlX0FwcGVuZGl4Si5wbmciKSkKYGBgCgpXZSB3aWxsIGJlIHVzaW5nIGEgc3Vic2V0IG9mIHRoZXNlIHZhcmlhYmxlcywgd2hpY2ggYXJlIGhpZ2hsaWdodGVkIGluIGdyZWVuOgoKCmBgYHtyLCBlY2hvPUZBTFNFLCBvdXQuaGVpZ2h0ID0gJzEwMCUnLCBvdXQud2lkdGggPSAnMTAwJScsIGZpZy5hbGlnbj0nY2VudGVyJ30Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoaGVyZSgiaW1nIiwgIm91cmRhdGEucG5nIikpCmBgYAoKCiMgKipEYXRhIEltcG9ydCoqCioqKgoKCgojIyBEZW1vZ3JhcGhpYyBhbmQgcG9wdWxhdGlvbiBkYXRhCgpUbyBvYnRhaW4gaW5mb3JtYXRpb24gYWJvdXQgYWdlLCBzZXgsIGFuZCByYWNlLCBhbmQgb3ZlcmFsbCBwb3B1bGF0aW9uIHdlIHdpbGwgdXNlIFVTIENlbnN1cyBCdXJlYXUgZGF0YSwganVzdCBsaWtlIGJvdGggb2YgdGhlIGFydGljbGVzLiBUaGUgY2VzbnVzIGRhdGEgaXMgYXZhaWxhYmxlIGZvciBkaWZmZXJlbnQgdGltZSBzcGFucy4gSGVyZSBhcmUgdGhlIGxpbmtzIGZvciB0aGUgeWVhcnMgdXNlZCBpbiBvdXIgYW5hbHlzaXMuIFdlIHdpbGwgdXNlIGRhdGEgZnJvbSAxOTc3IHRvIDIwMTAuCgpEYXRhICAgfCBMaW5rICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCi0tLS0tLS0tLS0gfC0tLS0tLS0tLS0tLS0KKip5ZWFycyAxOTc3IHRvIDE5NzkqKiAgfCBbbGlua10oaHR0cHM6Ly93d3cyLmNlbnN1cy5nb3YvcHJvZ3JhbXMtc3VydmV5cy9wb3Blc3QvdGFibGVzLzE5MDAtMTk4MC9zdGF0ZS9hc3JoLykgIAoqKnllYXJzIDE5ODAgdG8gMTk4OSoqICB8IFtsaW5rXShodHRwczovL3d3dzIuY2Vuc3VzLmdvdi9wcm9ncmFtcy1zdXJ2ZXlzL3BvcGVzdC90YWJsZXMvMTk4MC0xOTkwL2NvdW50aWVzL2FzcmgvKSAqIGNvdW50eSBkYXRhIHdhcyB1c2VkIGZvciB0aGlzIGRlY2FkZSB3aGljaCBhbHNvIGhhcyBzdGF0ZSBpbmZvcm1hdGlvbgoqKnllYXJzIDE5OTAgdG8gMTk5OSoqICB8IFtsaW5rXShodHRwczovL3d3dzIuY2Vuc3VzLmdvdi9wcm9ncmFtcy1zdXJ2ZXlzL3BvcGVzdC90YWJsZXMvMTk5MC0yMDAwL3N0YXRlL2FzcmgvKQoqKnllYXJzIDIwMDAgdG8gMjAxMCoqICB8IFtsaW5rXShodHRwczovL3d3dy5jZW5zdXMuZ292L2RhdGEvZGF0YXNldHMvdGltZS1zZXJpZXMvZGVtby9wb3Blc3QvaW50ZXJjZW5zYWwtMjAwMC0yMDEwLXN0YXRlLmh0bWwpIDxicj4gW3RlY2huaWNhbCBkb2N1bWVudGF0aW9uXShodHRwczovL3d3dzIuY2Vuc3VzLmdvdi9wcm9ncmFtcy1zdXJ2ZXlzL3BvcGVzdC90ZWNobmljYWwtZG9jdW1lbnRhdGlvbi9maWxlLWxheW91dHMvMjAwMC0yMDEwL2ludGVyY2Vuc2FsL3N0YXRlL3N0LWVzdDAwaW50LWFsbGRhdGEucGRmKXt0YXJnZXQ9Il9ibGFuayJ9CgpUbyBpbXBvcnQgdGhlIGRhdGEgd2Ugd2lsbCB1c2UgdGhlIGByZWFkX2NzdigpYCBmdW5jdGlvbiBvZiB0aGUgYHJlYWRyYCBwYWNrYWdlIGZvciB0aGUgY3N2IGZpbGVzLiBJbiBzb21lIGRlY2FkZXMsIHRoZXJlIGFyZSBzZXBhcmF0ZSBmaWxlcyBmb3IgZWFjaCB5ZWFyLCB3ZSB3aWxsIHJlYWQgZWFjaCBvZiB0aGVzZSB0b2dldGhlciB1c2luZyB0aGUgYmFzZSBgbGlzdC5maWxlcygpYCBmdW5jdGlvbiB0byBnZXQgYWxsIG9mIHRoZSBuYW1lcyBmb3IgZWFjaCBmaWxlIGFuZCB0aGVuIHRoZSBgbWFwKClgIGZ1bmN0aW9uIG9mIHRoZSBgcHVycnJgIHBhY2thZ2UgdG8gYXBwbHkgdGhlIGByZWFkX2NzdigpYCBmdW5jdGlvbiBvbiBhbGwgb2YgdGhlIGZpbGUgcGF0aHMgaW4gdGhlIGxpc3QgY3JlYXRlZCBieSBgbGlzdC5maWxlcygpYC4gRm9yIHllYXJzIHRoYXQgYXJlIHR4dCBmaWxlcyB3ZSB3aWxsIHVzZSBgcmVhZF90YWJsZTIoKWAgYWxzbyBmbyB0aGUgYHJlYWRyYCBwYWNrYWdlLiBUaGUgYHJlYWRfdGFibGUyKClgIGZ1bmN0aW9uLCB1bmxpa2UgdGhlIGByZWFkX3RhYmxlKClgLCAgYWxsb3dzIGZvciBhbnkgbnVtYmVyIG9mIHdoaXRlc3BhY2UgY2hhcmFjdGVycyBiZXR3ZWVuIGNvbHVtbnMsIGFuZCB0aGUgbGluZXMgY2FuIGJlIG9mIGRpZmZlcmVudCBsZW5ndGhzLgoKQVZPQ0FETyBJIGFtIGEgYml0IGNvbmZ1c2VkIGFib3V0IHRoZSBsYXN0IGRlY2FkZS4uLiBpdCdzIG9ubHkgb25lIGZpbGUgYnV0IGl0IHNlZW1zIHRvIG5lZWQgbWFwLi4uCgpgYGB7cn0KCmRlbV83N183OSA8LSByZWFkX2NzdigiZG9jcy9EZW1vZ3JhcGhpY3MvRGVjYWRlXzE5NzAvcGUtMTkuY3N2Iiwgc2tpcCA9IDUpCgpkZW1fODBfODkgPC0gbGlzdC5maWxlcyhyZWN1cnNpdmUgPSBUUlVFLAogICAgICAgICAgICAgICAgICBwYXRoID0gImRvY3MvRGVtb2dyYXBoaWNzL0RlY2FkZV8xOTgwLyIsCiAgICAgICAgICAgICAgICAgIHBhdHRlcm4gPSAiKi5jc3YiLAogICAgICAgICAgICAgICAgICBmdWxsLm5hbWVzID0gVFJVRSkgJT4lIAogIG1hcCh+cmVhZF9jc3YoLiwgc2tpcD01KSkKCmRlbV85MF85OSA8LSBsaXN0LmZpbGVzKHJlY3Vyc2l2ZSA9IFRSVUUsCiAgICAgICAgICAgICAgICAgIHBhdGggPSAiZG9jcy9EZW1vZ3JhcGhpY3MvRGVjYWRlXzE5OTAvIiwKICAgICAgICAgICAgICAgICAgcGF0dGVybiA9ICIqLnR4dCIsCiAgICAgICAgICAgICAgICAgIGZ1bGwubmFtZXMgPSBUUlVFKSAlPiUgCiAgbWFwKH5yZWFkX3RhYmxlMiguLCBza2lwID0gMTQpKQoKCmRlbV8wMF8xMF8yIDwtIHJlYWRfY3N2KCJkb2NzL0RlbW9ncmFwaGljcy9EZWNhZGVfMjAwMC9zdC1lc3QwMGludC1hbGxkYXRhLmNzdiIpCgpkZW1fMDBfMTAgPC0gbGlzdC5maWxlcyhyZWN1cnNpdmUgPSBUUlVFLAogICAgICAgICAgICAgICAgICBwYXRoID0gImRvY3MvRGVtb2dyYXBoaWNzL0RlY2FkZV8yMDAwLyIsCiAgICAgICAgICAgICAgICAgIHBhdHRlcm4gPSAiKi5jc3YiLAogICAgICAgICAgICAgICAgICAgZnVsbC5uYW1lcyA9IFRSVUUpICU+JSAKICAgbWFwKH5yZWFkX2NzdiguKSkKCmhlYWQoZGVtXzAwXzEwKQoKYGBgCgpOb3RpY2UgdGhhdCB0aGUgYFNUQVRFYCB2YXJpYWJsZSBmb3IgdGhlIGRlbW9ncmFwaGljIGRhdGEgaXMgbnVtZXJpYy4gVGhhdCBpcyBiZWNhdXNlIGl0IGlzIGVuY29kZWQgYnkgW0ZlZGVyYWwgSW5mb3JtYXRpb24gUHJvY2Vzc2luZyBTdGFuZGFyZCAoRklQUykgc3RhdGUgY29kZXNdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL0ZlZGVyYWxfSW5mb3JtYXRpb25fUHJvY2Vzc2luZ19TdGFuZGFyZF9zdGF0ZV9jb2RlKXt0YXJnZXQ9Il9ibGFuayIuIFRodXMgd2UgYWxzbyBuZWVkIHRvIGltcG9ydCBkYXRhICBhYm91dCBGSVBTIGVuY29kaW5nIHNvIHRoYXQgd2UgY2FuIGlkZW50aWZ5IHdoYXQgZGF0YSBjb3JyZXNwb25kcyB0byB3aGF0IHN0YXRlLgoKCiMjIFN0YXRlIEZJUFMgY29kZXMKCgoKVGhlIGZvbGxvd2luZyBkYXRhIHdhcyBkb3dubG9hZGVkIGZyb20gdGhlIFtVUyBDZW5zdXMgQnVyZWF1XShodHRwczovL3d3dy5jZW5zdXMuZ292L2dlb2dyYXBoaWVzL3JlZmVyZW5jZS1maWxlcy8yMDE0L2RlbW8vcG9wZXN0LzIwMTQtZ2VvY29kZXMtc3RhdGUuaHRtbCl7dGFyZ2V0PSJfYmxhbmsifS4KClRvIGltcG9ydCB0aGUgZGF0YSB3ZSB3aWxsIHVzZSB0aGUgYHJlYWRfeGxzKClgIGZ1bmN0aW9uIG9mIHRoZSBgcmVhZHhsYCBwYWNrYWdlLiBTaW5jZSB0aGUgZmlyc3QgZml2ZSBsaW5lcyBvZiB0aGlzIGV4Y2VsIGlzIGluZm9ybWF0aW9uIGFib3V0IHRoZSBzb3VyY2Ugb2YgdGhlIGRhdGEgYW5kIHdoZW4gaXQgd2FzIHJlbGVhc2VkLCB3ZSBuZWVkIHRvIHNraXAgaW1wb3J0aW5nIHRoZXNlIGxpbmVzIHVzaW5nIHRoZSBgc2tpcGAgYXJndW1lbnQgc28gdGhhdCB0aGUgZGF0YSBoYXMgdGhlIHNhbWUgbnVtYmVyIG9mIGNvbHVtbnMgZm9yIGVhY2ggcm93LiAKCmBgYHtyLCBvdXQud2lkdGggPSAiNTAwIHB4In0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoaGVyZSgiaW1nIiwgIkZJUFMucG5nIikpCgpgYGAKCmBgYHtyfQpTVEFURV9GSVBTIDwtIHJlYWRfeGxzKCJkb2NzL1N0YXRlX0ZJUFNfY29kZXMvc3RhdGUtZ2VvY29kZXMtdjIwMTQueGxzIiwgc2tpcCA9IDUpCihTVEFURV9GSVBTKQpgYGAKCiMjIFBvbGljZSBzdGFmZmluZyBkYXRhClRoZSBmb2xsb3dpbmcgZGF0YSB3YXMgZG93bmxvYWRlZCBmcm9tIHRoZSBbRmVkZXJhbCBCdXJlYXUgb2YgSW52ZXN0aWdhdGlvbl0oaHR0cHM6Ly9jcmltZS1kYXRhLWV4cGxvcmVyLmZyLmNsb3VkLmdvdi9kb3dubG9hZHMtYW5kLWRvY3MpLiAKCgpUaGUgYHJlYWRfY3N2KClgIGZ1bmN0aW9uIG9mIHRoZSBgcmVhZHJgIHBhY2thZ2UgZ3Vlc3NlcyB3aGF0IHRoZSBjbGFzcyBpcyBmb3IgZWFjaCB2YXJpYWJsZSwgYnV0IHNvbWV0aW1lcyBpdCBtYWtlcyBtaXN0YWtlcy4gSXQgaXMgZ29vZCB0byBzcGVjaWZ5IHRoZSBjbGFzcyBmb3IgdmFyaWFibGVzIGlmIHlvdSBrbm93IHRoZW0uIFdlIGtub3cgdGhhdCB3ZSB3YW50IHRoZSB2YXJpYWJsZXMgYWJvdXQgbWFsZSBhbmQgZmVtYWxlIGNvdW50cyB0byBiZSBudW1lcmljLiBXZSBjYW4gc3BlY2lmeSB0aGF0IHVzaW5nIHRoZSBgY29sX3R5cGVzID1gIGFyZ3VtZW50LiBTZWUgW2hlcmVdKGh0dHBzOi8vcmVhZHIudGlkeXZlcnNlLm9yZy9hcnRpY2xlcy9yZWFkci5odG1sKSBhbmQgW2hlcmVdKGh0dHBzOi8vY3Jhbi5yLXByb2plY3Qub3JnL3dlYi9wYWNrYWdlcy9yZWFkci92aWduZXR0ZXMvcmVhZHIuaHRtbCkgZm9yIG1vcmUgaW5mb3JtYXRpb24uCgpgYGB7cn0KcHNfZGF0YSA8LSByZWFkX2NzdigiZG9jcy9Qb2xpY2Vfc3RhZmZpbmcvcGVfMTk2MF8yMDE4LmNzdiIpCnBzX2RhdGEgPC0gcmVhZF9jc3YoImRvY3MvUG9saWNlX3N0YWZmaW5nL3BlXzE5NjBfMjAxOC5jc3YiLAogICAgICAgICAgICAgICAgICAgIGNvbF90eXBlcyA9IGNvbHMobWFsZV90b3RhbF9jdCA9ICJuIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZlbWFsZV90b3RhbF9jdCA9ICJuIikpCgpwc19kYXRhIDwtIHJlYWRfY3N2KCJkb2NzL1BvbGljZV9zdGFmZmluZy9wZV8xOTYwXzIwMTguY3N2IiwKICAgICAgICAgICAgICAgICAgIGNvbF90eXBlcyA9ICBjb2xzKG1hbGVfdG90YWxfY3QgPSBjb2xfZG91YmxlKCksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmVtYWxlX3RvdGFsX2N0ID0gY29sX2RvdWJsZSgpKSkKaGVhZChwc19kYXRhKSAgICAgICAgICAgICAgICAgICAgICAgICAgICAKYGBgCgoKCiMjIFVuZW1wbHltZW50IGRhdGEKClRoZSBmb2xsb3dpbmcgZGF0YSB3YXMgZG93bmxvYWRlZCBmcm9tIHRoZSBbVS5TLiBCdXJlYXUgb2YgTGFib3IgU3RhdGlzdGljc10oaHR0cHM6Ly9kYXRhLmJscy5nb3YvY2dpLWJpbi9kc3J2P2xhKS4gCgpUaGVyZSBhcmUgZXhjZWwgZmlsZXMgZm9yIGVhY2ggc3RhdGUuICBBcyB5b3UgY2FuIHNlZSwgdGhlcmUgYXJlIG1hbnkgcm93cyB0byBza2lwIHRvIG1ha2Ugc3VyZSB0aGF0IHRoZXJlIGFyZSB0aGUgc2FtZSBudW1iZXIgb2YgY29sdW1ucyBmb3IgZWFjaCByb3cuIFdlIGNhbiBhbHNvIHNlZSB0aGF0IHRoZSBzdGF0ZSBuYW1lIGlzIGxvY2F0ZWQgaW4gYSBjb3VwbGUgb2YgdGhlIGZpcnN0IHJvd3MuIAoKYGBge3J9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJVbmVtcC5wbmciKSkKYGBgCgpXZSBjYW4gYWxzbyBzZWUgdGhhdCBoZXJlIGlmIHdlIGp1c3QgdHJ5IHRvIHJlYWQgaW4gdGhlIGZpbGVzIGRpcmVjdGx5LgoKYGBge3J9Cgp1ZV9yYXRlX2RhdGEgPC0gbGlzdC5maWxlcyhyZWN1cnNpdmUgPSBUUlVFLAogICAgICAgICAgICAgICAgICBwYXRoID0gImRvY3MvVW5lbXBsb3ltZW50IiwKICAgICAgICAgICAgICAgICAgcGF0dGVybiA9ICIqLnhsc3giLAogICAgICAgICAgICAgICAgICBmdWxsLm5hbWVzID0gVFJVRSkgJT4lIAogIG1hcCh+cmVhZF94bHN4KC4pKQogICAgICAKaGVhZCh1ZV9yYXRlX2RhdGEpWzFdCmBgYAoKU28gbm93IHdlIHdpbGwgc2tpcCB0aGUgZmlyc3QgMTAgbGluZXMuIEFuZCBhbHNvIGNyZWF0ZSBhIG5hbWVzIHRpYmJsZSB0aGF0IGNvbnRhaW5zIG9ubHkgdGhlIGNlbGwgd2l0aCB0aGUgc3RhdGUgaW5mb3JtYXRpb24uCgpgYGB7cn0KIAogdWVfcmF0ZV9kYXRhIDwtIGxpc3QuZmlsZXMocmVjdXJzaXZlID0gVFJVRSwKICAgICAgICAgICAgICAgICAgcGF0aCA9ICJkb2NzL1VuZW1wbG95bWVudCIsCiAgICAgICAgICAgICAgICAgIHBhdHRlcm4gPSAiKi54bHN4IiwKICAgICAgICAgICAgICAgICAgZnVsbC5uYW1lcyA9IFRSVUUpICU+JSAKICBtYXAofnJlYWRfeGxzeCguLCBza2lwID0gMTApKQogIApoZWFkKHVlX3JhdGVfZGF0YVsxXSkKYGBgCgpUbyBnZXQgdGhlIHN0YXRlIG5hbWUgZm9yIGVhY2ggZmlsZSB1c2luZyB0aGUgYG1hcCgpYCBmdW5jdGlvbiB0byBwZXJmb3JtIGZ1bmN0aW9ucyBhY3Jvc3MgYWxsIG9mIHRoZSBmaWxlcywgd2Ugd2lsbCBzcGVjaWZpY2FsbHkgaW1wb3J0IG9ubHkgYSBzbWFsbCByYW5nZSBvZiBjZWxscyB1c2luZyB0aGUgYHJhbmdlID0gYCBhcmd1bWVudCBhbmQgdGhlbiBncmFiIHRoZSBjZWxsIHRoYXQgaGFzIHN0YXRlIGluZm9ybWF0aW9uIGJhc2VkIG9uIGl0J3MgbG9jYXRpb24gd2l0aGluIHRoZSByYW5nZSBvZiBjZWxscyBpbXBvcnRlZCB1c2luZyBgYygpYCBhbmQgdGhlbiB1c2UgdGhlIGJhc2UgYHVubGlzdCgpYCBmdW5jdGlvbiB0byB1bmxpc3QgdGhlIGxpc3QgdGhhdCB0aGlzIGNyZWF0ZXMuCgpgYGB7cn0KdWVfcmF0ZV9uYW1lcyA8LSBsaXN0LmZpbGVzKHJlY3Vyc2l2ZSA9IFRSVUUsCiAgICAgICAgICAgICAgICAgIHBhdGggPSAiZG9jcy9VbmVtcGxveW1lbnQiLAogICAgICAgICAgICAgICAgICBwYXR0ZXJuID0gIioueGxzeCIsCiAgICAgICAgICAgICAgICAgIGZ1bGwubmFtZXMgPSBUUlVFKSAlPiUKICBtYXAofnJlYWRfeGxzeCguLCByYW5nZSA9ICJCNDpCNiIpKSAlPiUKICBtYXAoLiwgYygxLDIpKSAlPiUKICB1bmxpc3QoKQoKdWVfcmF0ZV9uYW1lcwpgYGAKCk5vdyB3ZSB3aWxsIG1ha2UgdGhlc2UgdmFsdWVzIHRoZSBuYW1lcyBvZiB0aGUgZGlmZmVyZW50IHRpYmJsZXMgd2l0aGluIGB1ZV9yYXRlX2RhdGFgLgpgYGB7cn0KbmFtZXModWVfcmF0ZV9kYXRhKSA8LSB1ZV9yYXRlX25hbWVzCmBgYAoKIyMgUG92ZXJ0eSBkYXRhCkV4dHJhY3RlZCBmcm9tIFRhYmxlIDIxIGZyb20gW1VTIENlbnN1cyBCdXJlYXUgUG92ZXJ0eSBEYXRhIF0oaHR0cHM6Ly93d3cuY2Vuc3VzLmdvdi9kYXRhL3RhYmxlcy90aW1lLXNlcmllcy9kZW1vL2luY29tZS1wb3ZlcnR5L2hpc3RvcmljYWwtcG92ZXJ0eS1wZW9wbGUuaHRtbCkKCkFWT0NhZG8gc3RyYW5nZSBpc3N1ZQoKYGBge3J9CgojKipwZXJzaXN0ZW50IHdhcm5pbmcgZnJvbSB1bmtub3duIG9yaWdpbioqIGh0dHBzOi8vY29tbXVuaXR5LnJzdHVkaW8uY29tL3QvcGVyc2lzdGVudC11bmtub3duLW9yLXVuaW5pdGlhbGlzZWQtY29sdW1uLXdhcm5pbmdzLzY0ODc5Cgojc29sdXRpb24gdG8gYWJvdmUgaXMgYWxsZWRnZWRseTogIkluIGFueSBjYXNlIHRoZSBzdWdnZXN0ZWQgYXBwcm9hY2ggaXMgdG8gaW5pdGlhbGl6ZSB0aGUgY29sdW1uIgoKCnBvdmVydHlfcmF0ZV9kYXRhIDwtIHJlYWRfeGxzKCJkb2NzL1BvdmVydHkvaHN0cG92MjEueGxzIiwgc2tpcD0yKSAjVGhpcyBtYXkgY2F1c2UgaW5pdGlhbGl6YXRpb24gaXNzdWUsIG5vdCBlYXNpbHkgcmVwcm9kdWNpYmxlIChldmVuIGFmdGVyIHJlc3RhcnRpbmcgUikKCmhlYWQocG92ZXJ0eV9yYXRlX2RhdGEpCmBgYAoKV2UgY2FuIHNlZSB0aGF0IHRoaXMgd2lsbCByZXF1aXJlIHNvbWUgd3JhbmxnaW5nIHRvIG1ha2UgdGhlIGRhdGEgbW9yZSB1c2FibGUuIAoKIyMgVmlvbGVudCBjcmltZQoKVmlvbGVudCBjcmltZSBkYXRhIHdhcyBvYnRhaW5lZCBmcm9tIFtoZXJlXShodHRwczovL3d3dy51Y3JkYXRhdG9vbC5nb3YvU2VhcmNoL0NyaW1lL1N0YXRlL1N0YXRlYnlTdGF0ZS5jZm0pIFRoaXMgZGF0YSBpcyBhIGJpdCB0cmlja2llciBiZWNhdXNlIG9mIHNwYWNlcyBhbmQgYC9gIGluIHRoZSBjb2x1bW4gbmFtZXMsIHRodXMgdGhlIGByZWFkX2xpbmVzKClgIGZ1bmN0aW9uIG9mIHRoZSBgcmVhZHJgIHBhY2thZ2Ugd29ya3MgYmV0dGVyIHRoYW4gdGhlIGByZWFkX2NzdigpYCBmdW5jdGlvbi4KCgpgYGB7cn0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoaGVyZSgiaW1nIiwgImNyaW1lLnBuZyIpKQpgYGAKCmBgYHtyfQpjcmltZV9kYXRhIDwtIHJlYWRfbGluZXMoImRvY3MvQ3JpbWUvQ3JpbWVTdGF0ZWJ5U3RhdGUuY3N2Iiwgc2tpcCA9IDIsIHNraXBfZW1wdHlfcm93cyA9IFRSVUUpCmhlYWQoY3JpbWVfZGF0YSkKCmBgYAoKV2UgY2FuIHNlZSB0aGF0IHRoaXMgZGF0YSB3aWxsIGFsc28gcmVxdWlyZSBzb21lIHdyYW5sZ2luZyB0byBtYWtlIGl0IG1vcmUgdXNhYmxlLiAKCiMjIFJpZ2h0LXRvLWNhcnJ5IGRhdGEKClRoaXMgZGF0YSBpcyBleHRyYWN0ZWQgZnJvbSB0YWJsZSBpbiBbRG9ub2h1ZSBwYXBlcl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpIHt0YXJnZXQ9Il9ibGFuayJ9LiBXZSB3aWxsIHVzZSB0aGUgZnVuY3Rpb24gYHBkZl90ZXh0KClgICBvZiB0aGUgYHBkZnRvb2xzYCBwYWNrYWdlIHRvIGltcG9ydCB0aGUgcGRmIGRvY3VtZW50LgoKYGBge3J9CgppZighZmlsZS5leGlzdHMoaGVyZSgiZG9jcyIsICJ3MjM1MTAucGRmIikpKXsKICB1cmwgPC0gImh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmIgogIHV0aWxzOjpkb3dubG9hZC5maWxlKHVybCwgaGVyZSgiZG9jcyIsICJ3MjM1MTAucGRmIikpCn0KCkRBV3BhcGVyIDwtIHBkZl90ZXh0KGhlcmUoImRvY3MiLCAidzIzNTEwLnBkZiIpKQoKaGVhZChEQVdwYXBlclsxXSkKCmBgYAoKQWdhaW4sIHRoaXMgZGF0YSB3aWxsIGFsc28gcmVxdWlyZSBxdWl0ZSBhIGJpdCBvZiB3cmFuZ2xpbmcuCgoKCiMgKipEYXRhIFdyYW5nbGluZyoqCioqKgojIyBTdGF0ZSBGSVBTIGNvZGVzCgpMZXQncyBmaXJzdCB0YWtlIGEgbG9vayBhdCBvdXIgc3RhdGUgRklQUyBkYXRhIHRvIHNlZSBpZiBpdCBuZWVkcyBhbnkgY2xlYW5pbmcgb3IgcmVzaGFwaW5nLiBXZSBzaG91bGQgc3RhcnQgd2l0aCB0aGlzIGRhdGEsIGJlY3Vhc2Ugd2Ugd2lsbCBuZWVkIHRvIHVzZSBpdCB0byB3cmFuZ2xlIHNvbWUgb2YgdGhlIG90aGVyIGRhdGEuCgpgYGB7cn0KaGVhZChTVEFURV9GSVBTKQpgYGAKCldlIG9ubHkgbmVlZCB0aGUgbGFzdCB0d28gY29sdW1ucywgYnV0IHdlIG1pZ2h0IHdhbnQgdG8gcmVuYW1lIHRoZW0uIFRoZSBgTmFtZWAgdmFyaWFibGUgaXMgdmFndWUuIFRoZSB2YXJpYWJsZSB3aXRoIHRoZSBGSVBTIGNvZGUgaXMgY2FsbGVkIGBTdGF0ZVxuKEZJUFMpYC4gVG8gZ2V0IHJpZCBvZiB0aGUgbmV3IGxpbmUgaW4gdGhpcyB2YXJpYWJsZSBuYW1lIGFuZCB0byBjaGFuZ2UgdGhlIGBOYW1lYCB2YXJpYWJsZSB0byBzb21ldGhpbmcgbW9yZSBpbmZvcm1hdGl2ZSwgd2Ugd2lsbCB1c2UgdGhlIGByZW5hbWUoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gIFRvIHVzZSB0aGlzIGZ1bmN0aW9uLCB3ZSBuZWVkIHRvIGxpc3QgdGhlIG5ldyBuYW1lIGZpcnN0IGZvbGxvd2VkIGJ5IGA9YCBhbmQgdGhlbiB0aGUgZXhpc3RpbmcgdmFyaWFibGUuIFdlIGNhbiByZW5hbWUgbXVsdGlwbGUgdmFyaWFibGVzIGF0IHRoZSBzYW1lIHRpbWUgYnkgdXNpbmcgYSBjb21tYSB0byBzZXBhcmF0ZSB0aGUgdmFyaWFibGVzIHdlIGFyZSByZW5hbWluZy4gV2Ugd2lsbCB1c2UgdGhlIGBzZWxlY3QoKWAgZnVuY3Rpb24gYWxzbyBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlIGp1c3QgdG8ga2VlcCB0aGVzZSB2YXJpYWJsZXMsIGFuZCB3ZSB3aWxsIGZpbHRlciBvdXQgdGhlIHJvd3Mgd2l0aCBGSVBTIHZhbHVlcyBvZiBgMDBgIHdpdGggdGhlIGBmaWx0ZXIoKWAgZnVuY3Rpb24sIGFnaWFuIGFsc28gcGFydCBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlLiB3ZSB3aWxsIHNwZWNpZnkgdGhhdCB3ZSB3YW50IGBTVEFURUZQYCB2YWx1ZXMgdGhhdCBhcmUgbm90IGVxdWFsIHRvIGAwMGAgYnkgdXNpbmcgdGhpcyBvcGVyYXRvcjogYCE9YC4gV2Ugd2lsbCBhbHNvIHVzZSB0aGUgZG91YmxlIHBpcGUgb3BlcmF0b3IgYCU8PiVgIG9mIHRoZSBgbWFncml0dHJgIHBhY2thZ2Ugd2hpY2ggYWxsb3dzIHVzIHRvIHVzZSBkYXRhIGFzIGl1cHV0IGFuZCB0aGVuIHJlYXNzaWduIGl0IGFmdGVyIHdlIHBlZm9ybSBzdW0gZnVuY3Rpb25zIHVzaW5nIGl0LgoKYGBge3J9CgpTVEFURV9GSVBTICU8PiUgCmRwbHlyOjpyZW5hbWUoIFNUQVRFRlAgPSBgU3RhdGVcbihGSVBTKWAsCiAgICAgICAgICAgICAgICAgU1RBVEUgPSBOYW1lKSAlPiUKICAgIGRwbHlyOjpzZWxlY3QoU1RBVEVGUCwgU1RBVEUpICU+JQogICAgZHBseXI6OmZpbHRlcihTVEFURUZQICE9ICIwMCIpCgpTVEFURV9GSVBTCgpgYGAKCiMjIERlbW9ncmFwaGljIGFuZCBwb3B1bGF0aW9uIGRhdGEKCgo8ZGV0YWlscz48c3VtbWFyeT4gQ2xpY2sgaGVyZSB0byBzZWUgZGV0YWlsZWQgaW5mb3JtYXRpb24gYWJvdXQgaG93IHRoZSBkZW1vZ3JwaGljIGRhdGEgd2FzIHdyYW5nbGVkIDwvc3VtbWFyeT4KCgo8Zm9udCBzaXplPSI2Ij4gKioxOTc3LTE5NzkqKjwvZm9udD4KCioqKgoKCk5vdyBsZXQncyB0YWtlIGEgbG9vayBhdCBvdXIgZGVtb2dyYXBoaWMgZGF0YSBhY3Jvc3MgdGhlIGRlY2FkZXMgdGhhdCB3ZSB3aXNoIHRvIHN0dWR5LiBJZiB5b3UgaGF2ZSB2ZXJ5IHdpZGUgZGF0YSAobWVhbmluZyBpdCBoYXMgbWFueSBjb2x1bW5zKSwgb25lIHdheSB0byB2aWV3IHRoZSBkYXRhIHNvIHRoYXQgeW91IGNhbiBzZWUgYWxsIG9mIHRoZSBjb2x1bW5zIGF0IHRoZSBzYW1lIHRpbWUgaXMgdG8gdXNlIHRoZSBgZ2xpbXBzZSgpYCBmdW5jdGlvbiBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlLiAKClRha2luZyBhIGxvb2sgYXQgdGhlIGZpcnN0IGRlY2FkZSBvZiBkYXRhLCB3ZSBjYW4gc2VlIHRoYXQgdGhlIGBSYWNlL1NleCBJbmRpY2F0b3JgIGNvbnRhaW5zIHR3byB0eXBlcyBvZiBkYXRhLCB0aGUgcmFjZSBhbmQgdGhlIHNleC4gVGhpcyBkb2VzIG5vdCBmb2xsb3cgdGhlIHRpZHkgZGF0YSBwaGlsb3NvcGh5LCB3aGVyZSBlYWNoIGNlbGwgb2YgYSB0aWJibGUgc2hvdWxkIG9ubHkgY29udGFpbiBvbmUgcGllY2Ugb2YgaW5mb3JtYXRpb24uIFR5cGljYWxseSBvbmUgbWlnaHQgdGhpbmsgb2YgdXNpbmcgdGhlIGBzZXBhcmF0ZSgpYCBmdW5jdGlvbiBvZiB0aGUgYHRpZHlyYCBwYWNrYWdlIHRvIHNwbGl0IHRoaXMgdmFyaWFibGUgaW50byB0d28uIEhvd2V2ZXIsIG9uZSBvZiB0aGUgcmFjZSB2YWx1ZXMgaXMgYE90aGVyIHJhY2VzYCBhbmQgc2luY2UgdGhpcyBhbHNvIGhhcyBhIHNwYWNlLCB0aGlzIG1ha2VzIHNlcGFyYXRpbmcgdGhpcyBkYXRhIG1vcmUgdHJpY2t5LgoKSW5zdGVhZCB3ZSB3aWxsIHVzZSB0aGUgYHN0cl9leHRyYWN0KClgIGZ1bmN0aW9uIG9mIHRoZSBgc3RyaW5ncmAgcGFja2FnZSBhbmQgdGhlIGBtdXRhdGUoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gVGhlICJtdXRhdGUoKSIgd2lsbCBhbGxvdyB1cyB0byBjcmVhdGUgbmV3IHZhcmlhYmxlcywgYW5kICJzdHJfZXh0cmFjdCgpIiBmdW5jdGlvbiAgd2lsbCBhbGxvdyB1cyB0byBtYXRjaCBzcGVjaWZpYyBwYXR0ZXJucyBhbmQgcHVsbCBvdXQgbWF0Y2hlcyB0byB0aG9zZSBwYXR0ZXJucy4gVGhlcmVmb3JlLCBpZiB0aGUgYFJhY2UvU2V4IEluZGljYXRvcmAgdmFsdWUgaXMgYE90aGVyIHJhY2VzIG1hbGVgIGFuZCBpZiB3ZSBleHRyYWN0IHBhdHRlcm5zIG1hdGNoaW5nIGVpdGhlciBgIm1hbGUiYCBvciBgImZlbWFsZSJgIHdoaWNoIHdlIGNhbiBzcGVjaWZ5IGxpa2UgdGhpcyBgcGF0dGVybiA9ICJtYWxlfGZlbWFsZSJgIHRoZW4sIHRoZSB2YWx1ZSB3aWxsIGJlIGBtYWxlYC4KCkZpcnN0IHdlIG5lZWQgdG8gcmVuYW1lIHRoZSBgUmFjZS9TZXggSW5kaWNhdG9yYCB2YXJhaWJsZSB0byBub3QgaGF2ZSBzcGFjZXMgc28gdGhhdCBpdCBpcyBjb21wYXRpYmxlIHdpdGggdGhlIGBzdHJfZXh0cmFjdCgpYCBmdW5jdGlvbi4KCldlIGFsc28gd2FudCB0byByZW5hbWUgYSBjb3VwbGUgb2YgdmFyaWFibGVzIHRvIGJlIHNpbXBsZXIgYW5kIGZpbHRlciB0aGUgZGF0YSB0byBvbmx5IGluY2x1ZGUgdGhlIHllYXJzIG9mIHRoZSBkYXRhIHdlIGFyZSBpbnRlcmVzdGVkIGluLCBhcyB3ZWxsIGFzIHJlbW92ZSBzb21lIHZhcmlhYmxlcyB0aGF0IHdlIGRvbnQgbmVlZCBsaWtlIHRoZSBgRklQUyBTdGF0ZSBDb2RlYC4gV2UgY2FuIHJlbW92ZSB2YXJpYWJsZXMgYnkgdXNpbmcgdGhlIGBzZWxlY3QoKWAgZnVuY3Rpb24gd2l0aCBhIGAtYCBtaW51cyBzaWduIGluIGZyb250IG9mIHRoZSB2YXJpYWJsZSB3ZSB3aXNoIHRvIHJlbW92ZS4KCmBgYHtyfQpkcGx5cjo6Z2xpbXBzZShkZW1fNzdfNzkpCgoKZGVtXzc3Xzc5IDwtIGRlbV83N183OSAlPiUKICByZW5hbWUoInJhY2Vfc2V4IiA9YFJhY2UvU2V4IEluZGljYXRvcmApICU+JQogIG11dGF0ZShTRVggPSBzdHJfZXh0cmFjdChyYWNlX3NleCwgIm1hbGV8ZmVtYWxlIiksCiAgICAgICAgUkFDRSA9IHN0cl9leHRyYWN0KHJhY2Vfc2V4LCAiQmxhY2t8V2hpdGV8T3RoZXIiKSklPiUKICBzZWxlY3QoLWBGSVBTIFN0YXRlIENvZGVgLCAtYHJhY2Vfc2V4YCkgJT4lCiAgcmVuYW1lKCJZRUFSIiA9IGBZZWFyIG9mIEVzdGltYXRlYCwKICAgICAgICAiU1RBVEUiID0gYFN0YXRlIE5hbWVgKSAlPiUKICBmaWx0ZXIoWUVBUiAlaW4lIDE5Nzc6MTk3OSkKCmdsaW1wc2UoZGVtXzc3Xzc5KQpgYGAKClRoYXQncyBsb29raW5nIHByZXR0eSAgZ29vZCEgV2UgYWxzbyB3YW50IHRvIHRha2UgYWxsIHRoZSBhZ2UgZ3JvdXAgdmFyaWFiZWxzIGFuZCBtYWtlIG9uZSB2YXJpYWJsZSB0aGF0IGlzIHRoZSBhZ2UgZ3JvdXAgbmFtZSBhbmQgb25lIHRoYXQgaXMgdGhlIHZhbHVlIG9mIHRoZSBwb3B1bGF0aW9uIGNvdW50IGZvciB0aGF0IGFnZSBncm91cC4gVG8gZG8gdGhpcyB3ZSB3aWxsIHVzZSB0aGUgYHBpdm90X2xvbmdlcigpYCBmdW5jdGlvbiBvZiB0aGUgYHRpZHlyYCBwYWNrYWdlLiBUbyB1c2UgdGhpcyBmdW5jdGlvbiwgd2UgbmVlZCB0byB1c2UgdGhlIGBjb2xzYCBhcmd1bWVudCB0byBpbmRpY2F0ZSB3aGljaCBjb2x1bW5zIHdlIHdhbnQgdG8gcGl2b3QuIFdlIGFsc28gbmFtZSB0aGUgbmV3IHZhcmlhYmxlcyB3ZSB3aWxsIGNyZWF0ZSB3aXRoIHRoZSBgbmFtZXNfdG9gIGFuZCBgdmFsdWVzX3RvYCBhcmd1bWVudHMuIFRoZSBgbmFtZXNfdG9gIHdpbGwgYmUgdGhlIG5hbWUgb2YgdGhlIHZhcmlhYmxlIHRoYXQgd2lsbCBpZGVudGlmeSBlYWNoIGFnZSBncm91cCBhbmQgYHZhbHVlc190b2Agd2lsbCBiZSB0aGUgbmFtZSBvZiB0aGUgdmFyaWFibGUgdGhhdCBjb250YWlucyB0aGUgY29ycmVzcG9uZGluZyBwb3B1bGF0aW9uIHZhbHVlcy4KYGBge3J9CmRlbV83N183OSA8LSBkZW1fNzdfNzkgJT4lCiAgcGl2b3RfbG9uZ2VyKGNvbHM9Y29udGFpbnMoInllYXJzIiksCiAgICAgICAgICAgICAgIG5hbWVzX3RvID0gIkFHRV9HUk9VUCIsCiAgICAgICAgICAgICAgIHZhbHVlc190byA9ICJTVUJfUE9QIikKCmdsaW1wc2UoZGVtXzc3Xzc5KQpgYGAKCldlIGFsc28gd2FudCB0byBnZXQgZGF0YSBhYm91dCB0aGUgdG90YWwgcG9wdWxhdGlvbiBmb3IgdGhlIHN0YXRlIGZvciBlYWNoIHllYXIuCgpUbyBkbyBzbyB3ZSBjYW4gc3VtIGFsbCB0aGUgdmFsdWVzIGZvciB0aGUgYFNVQl9QT1BgIHZhcmlhYmxlIHRoYXQgd2UganVzdCBjcmVhdGVkLiBUbyBkbyB0aGlzIHdlIGNhbiB1c2UgdGhlIGBncm91cF9ieWAgYW5kIGBzdW1tYXJpc2UoKWAgZnVuY3Rpb25zIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UuIFRoZSBgZ3JvdXBfYnkoKWAgZnVuY3Rpb24gc3BlY2lmaWVzIGhvdyB3ZSB3YW50IHRvIGNhbGN1bGF0ZSAgb3VyIHN1bSwgdGhhdCB3ZSB3b3VsZCBsaWtlIHRvIGNhbGN1bGF0ZSBpdCBmb3IgZWFjaCB5ZWFyIGFuZCBlYWNoIHN0YXRlIGluZGl2aWR1YWxseS4gVGh1cywgYWxsIHRoZSB2YWx1ZXMgdGhhdCBoYXZlIHRoZSBzYW1lIGBTVEFURWAgYW5kIGBZRUFSYCB2YWx1ZXMgd2lsbCBiZSBzdW1tZWQgdG9nZXRoZXIsIHJhdGhlciB0aGFuIHN1bW1pbmcgdXNpbmcgYWxsIG9mIHRoZSB2YWx1ZXMgaW4gdGhlIGBTVUJfUE9QYCB2YXJpYWJsZS4gVGhlIGAuZ3JvdXBzYCBhcmd1bWVudCBhbGxvd3MgdXMgdG8gcmVtb3ZlIHRoZSBncm91cGluZyBhZnRlciB3ZSBwZWZvcm0gdGhlIGNhbGN1bGF0aW9uIHdpdGggYHN1bW1hcmlzZSgpYC4KCmBgYHtyfQpwb3BfNzdfNzkgPC0gZGVtXzc3Xzc5ICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFKSAlPiUKICBzdW1tYXJpc2UoIlRPVF9QT1AiID0gc3VtKFNVQl9QT1ApLCAuZ3JvdXBzID0gImRyb3AiKSAKCnBvcF83N183OSAKYGBgCgoKIE5vdyB3ZSB3aWxsIGFkZCB0aGUgcG9wdWxhdGlvbiB2YWx1ZSB0byB0aGUgZGVtb2dyYXBoaWMgdGliYmxlIHVzaW5nIHRoZSBgbGVmdF9qb2luKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UuIEl0IGlzIGltcG9yYW50IHRoYXQgd2Ugc3BlY2lmeSBob3cgdGhpcyBzaG91bGQgYmUgZG9uZSwgdGhhdCB0aGUgYFlFQVJgIGFuZCBgU1RBVEVgIHZhcmlhYmxlIHZsYXVlcyBzaG91bGQgbWF0Y2ggZWFjaG90aGVyLiBUaGlzIHdpbGwgcGxhY2UgdGhlIGBkZW1fNzdfNzlgIHZhcmlhYmxlcyB0byB0aGUgbGVmdCBvZiB0aGUgYHBvcF83N183OWAgZGF0YS4gCiAKYGBge3J9CmRlbV83N183OSA8LSBkZW1fNzdfNzkgJT4lCiAgbGVmdF9qb2luKHBvcF83N183OSwgYnkgPSBjKCJZRUFSIiwiU1RBVEUiKSkKCmRlbV83N183OQpgYGAKCldlIHdpbGwgYWxzbyBjYWxjdWxhdGUgdGhlIHBlcmNlbnRhZ2UgdGhhdCBlYWNoIGdyb3VwIG1ha2VzIHVwIG9mIHRoZSB0b3RhbCBwb3B1bGF0aW9uLCBieSBkaXZpZGluZyB0aGUgYFNVQl9QT1BgIGJ5IHRoZSBgVE9UX1BPUGAgYW5kIG11bHRpcGx5aW5nIGJ5IDEwMCB1c2luZyB0aGUgYG11dGF0ZSgpYCBmdW5jdGlvbi4gd2Ugd2lsbCBhbHNvIHJlbW92ZSB0aGUgb3RoZXIgcG9wdWxhdGlvbiB2YXJpYWJsZXMuCgpgYGB7cn0KZGVtXzc3Xzc5ICU8PiUKICBtdXRhdGUoUEVSQ19TVUJfUE9QID0gKFNVQl9QT1AvVE9UX1BPUCkqMTAwKSAlPiUKICBzZWxlY3QoLVNVQl9QT1AsIC1UT1RfUE9QKQoKZGVtXzc3Xzc5CmBgYApJdCBpcyBpbXBvcnRhbnQgdG8gbWFrZSBzdXJlIHRoYXQgd2UgaGF2ZSB0aGUgdG90YWwgdmFsdWVzIHdlIHdvdWxkIGV4cGVjdC4gV2UgaGF2ZSB0d28gbGV2ZWxzIG9mIGBTRVhgLCB0aHJlZSBsZXZlbHMgb2YgYFJhY2VgLCB0aHJlZSBsZXZlbHMgb2YgYFlFQVJgLCBlaWdodGVlbiBsZXZlbHMgb2YgYEFHRV9HUk9VUGAsIGFuZCBmaWZ0eSBvbmUgbGV2ZWxzIG9mIGBTVEFURWAuIElmIHdlIG11bHRpcGx5IHRoaXMgdG9nZXRoZXIgd2UgZ2V0IDE2LDUyNCB3aGljaCBpcyB0aGUgc2FtZSBhcyB0aGUgbnVtYmVyIG9mIHJvd3MgaW4gb3VyIGZpbmFsIGBkZW1fNzdfNzlgIGRhdGEuIExvb2tzIGdvb2QhCgpBbHNvIExldCdzIG1ha2UgdGhlIHZhbHVlcyBvZiB0aGUgYFNFWGAgdmFyaWFibGUgY2FwYXRhbGl6ZWQgc28gdGhhdCB0aGV5IG1hdGNoIHRoZSBvdGhlciB2YWx1ZXMgb2YgdGhlIG90aGVyIHZhcmlhYmxlcyBsaWtlIGBSQUNFYCBldGMuIFRoaXMgd2lsbCBoZWxwIHVzIHRvIGtlZXAgY29uc2lzdGVudCB2YWx1ZXMgYWNyb3NzIHRoZSBkaWZmZXJlbnQgeWVhcnMgYXMgd2Ugd3JhbmdsZSB0aGUgZGF0YSBmb3IgdGhlIG90aGVyIGRlY2FkZXMuIFRvIGRvIHNvIHdlIHdpbGwgdXNlIHRoZSBgc3RyX3RvX3RpdGxlKClgIGZ1bmN0aW9uIG9mIHRoZSBgc3RyaW5ncmAgcGFja2FnZS4gV2UgbmVlZCB0byB1c2UgdGhlIGBwdWxsKClgIGZ1bmN0aW9uIHRvIGdldCB0aGUgdmFsdWVzIG9mIGBTRVhgIG91dCBvZiBgZGVtXzc3Xzc5YC4gT25jZSB3ZSBtYWtlIHRoZW0gY2FwdGlhbGl6ZWQgdGhleSBhcmUgdGhlbiByZWFzaWduZWQgdG8gdGhlIGBTRVhgIHZhcmlhYmxlLiAKCmBgYHtyfQoKZGVtXzc3Xzc5ICU8PiUKICBtdXRhdGUoU0VYID0gc3RyX3RvX3RpdGxlKHB1bGwoZGVtXzc3Xzc5LCBTRVgpKSkKCiMgVGhpcyBjYW4gYWxzbyBiZSBkb25lIGxpbmUgdGhpczoKZGVtXzc3Xzc5ICU8PiUKICBtdXRhdGUoU0VYID0gc3RyX3RvX3RpdGxlKHB1bGwoLiwgU0VYKSkpCmBgYAoKPGZvbnQgc2l6ZT0iNiI+ICoqMTk4MC0xOTg5Kio8L2ZvbnQ+CgoqKioKCgpGb3IgdGhpcyBkZWNhZGUgZWFjaCB5ZWFyIGlzIGEgc2VwYXJhdGUgdGliYmxlIGFuZCB0aGV5IGFyZSBjb21iaW5lZCBhcyBhIGxpc3QuCmBgYHtyfQpjbGFzcyhkZW1fODBfODkpCmBgYAoKU28gdGhlIGZpcnN0IHRoaW5nIHdlIG5lZWQgdG8gZG8gaXMgY29tYmluZSBlYWNoIHRpYmJsZSBvZiB0aGUgbGlzdCB0b2dldGhlci4gV2UgY2FuIGRvIHRoYXQgdXNpbmcgdGhlIGBiaW5kX3Jvd3MoKWAgZnVuY3Rpb24gb2YgYGRwbHlyYCB3aGljaCBhcHBlbmRzIHRoZSBkYXRhIHRvZ2V0aGVyIGJhc2VkIG9uIHRoZSBwcmVzZW5jZSBvZiBjb2x1bW5zIHdpdGggdGhlIHNhbWUgbmFtZSBpbiB0aGUgZGlmZmVyZW50IHRpYmJsZXMuIFdlIHdpbGwgdXNlIHRoZSBgbWFwX2RmKClgIGZ1bmN0aW9uIG9mIHRoZSBgcHVycnJgIHBhY2thZ2UgdG8gYWxsb3cgdXMgdG8gZG8gdGhpcyBhY3Jvc3MgZWFjaCB0aWJibGUgaW4gb3VyIGxpc3QuIAoKYGBge3J9CmRlbV84MF84OSA8LSBkZW1fODBfODkgJT4lCiAgbWFwX2RmKGJpbmRfcm93cykKCmdsaW1wc2UoZGVtXzgwXzg5ICkKYGBgCgpHcmVhdCEgTm93IG91ciBkYXRhIGlzIGFsbCB0b2dldGhlci4KCk5vdyB3ZSB3aWxsIHdyYW5nbGUgdGhlIGRhdGEgc2ltaWxhcmx5IHRvIHRoZSBwcmV2aW91cyBkZWNhZGUuCmBgYHtyfQpkZW1fODBfODkgPC0gZGVtXzgwXzg5ICU+JQogIHJlbmFtZSgicmFjZV9zZXgiID1gUmFjZS9TZXggSW5kaWNhdG9yYCkgJT4lCiAgbXV0YXRlKFNFWCA9IHN0cl9leHRyYWN0KHJhY2Vfc2V4LCAibWFsZXxmZW1hbGUiKSwKICAgICAgICBSQUNFID0gc3RyX2V4dHJhY3QocmFjZV9zZXgsICJCbGFja3xXaGl0ZXxPdGhlciIpKSU+JQogIHNlbGVjdCggLWByYWNlX3NleGApICU+JQogIHJlbmFtZSgiWUVBUiIgPSBgWWVhciBvZiBFc3RpbWF0ZWApCiAgICAgICAgIApnbGltcHNlKGRlbV84MF84OSkKYGBgCk5vdGljZSB0aGF0IHRoaXMgdGltZSB0aGUgc3RhdGUgaW5mb3JtYXRpb24gaXMgYmFzZWQgb24gdGhlIG51bWVyaWMgRklQUyB2YWx1ZS4gV2Ugd2FudCBvbmx5IHRoZSBmaXJzdCB0d28gdmFsdWVzLCBhcyB0aGUgcmVzdCBpbmRpY2F0ZSB0aGUgY291bnR5LiBXZSBjYW4gdXNlIHRoZSBgc3RyX3N1YigpYCBmdW5jdGlvbiBvZiB0aGUgYHN0cmluZ3JgIHBhY2thZ2UgZm9yIHRoaXMuIFdlIHdpbGwgc3BlY2lmeSB0aGF0IHdlIHdhbnQgdG8gc3RhcnQgYXQgdGhlIGZpcnN0IHBvc2l0aW9uIGFuZCBlbmQgYXQgdGhlIHNlY29uZC4gIEp1c3QgbGlrZSBgc3RyX2V4dHJhY3QoKWAgd2UgbmVlZCB0byByZW5hbWUgdGhpcyB2YXJpYWJsZSBmaXJzdCBzbyB0aGF0IGl0IGlzIGNvbXBhdGlibGUuIApgYGB7cn0KZGVtXzgwXzg5ICU8PiUKcmVuYW1lKCJTVEFURUZQX3RlbXAiID0gIkZJUFMgU3RhdGUgYW5kIENvdW50eSBDb2RlcyIpICU+JQptdXRhdGUoU1RBVEVGUCA9IHN0cl9zdWIoU1RBVEVGUF90ZW1wLCBzdGFydCA9IDEsIGVuZCA9IDIpKSAlPiUKICAgIGxlZnRfam9pbihTVEFURV9GSVBTLCBieSA9ICJTVEFURUZQIikgJT4lCiAgZHBseXI6OnNlbGVjdCgtU1RBVEVGUCkKCmdsaW1wc2UoZGVtXzgwXzg5KQpgYGAKCgpgYGB7cn0KZGVtXzgwXzg5ICU8PiUKICBwaXZvdF9sb25nZXIoY29scz1jb250YWlucygieWVhcnMiKSwKICAgICAgICAgICAgICAgbmFtZXNfdG8gPSAiQUdFX0dST1VQIiwKICAgICAgICAgICAgICAgdmFsdWVzX3RvID0gIlNVQl9QT1BfdGVtcCIpICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFLCBBR0VfR1JPVVAsIFNFWCwgUkFDRSkgJT4lCiAgc3VtbWFyaXNlKFNVQl9QT1AgPSBzdW0oU1VCX1BPUF90ZW1wKSwgLmdyb3Vwcz0iZHJvcCIpCgpkZW1fODBfODkKYGBgCiAgCmBgYHtyfQpwb3BfODBfODkgPC0gZGVtXzgwXzg5ICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFKSAlPiUKICBzdW1tYXJpc2UoIlRPVF9QT1AiID0gc3VtKFNVQl9QT1ApLCAuZ3JvdXBzID0gImRyb3AiKSAKCgpkZW1fODBfODkgPC0gZGVtXzgwXzg5ICU+JQogIGxlZnRfam9pbihwb3BfODBfODksIGJ5ID0gYygiWUVBUiIsIlNUQVRFIikpICU+JQogIG11dGF0ZShQRVJDX1NVQl9QT1AgPSAoU1VCX1BPUC9UT1RfUE9QKSoxMDApICU+JQogIGRwbHlyOjpzZWxlY3QoLVNVQl9QT1AsIC1UT1RfUE9QKQoKZGVtXzgwXzg5CmBgYAoKSnVzdCBsaWtlIHdpdGggdGhlIGRhdGEgZnJvbSB0aGUgNzBzIHdlIHdpbGwgYWxzbyBjaGFuZ2UgdGhlIHZhbHVlcyBmb3IgYFNFWGAgdG8gYmUgY2FwaXRhbGl6ZWQuCgpgYGB7cn0KZGVtXzgwXzg5ICU8PiUKICBtdXRhdGUoU0VYID0gc3RyX3RvX3RpdGxlKHB1bGwoLiwgU0VYKSkpCmBgYAoKQWdhaW4sIGl0IGlzIGltcG9ydGFudCB0byBtYWtlIHN1cmUgdGhhdCB3ZSBoYXZlIHRoZSB0b3RhbCB2YWx1ZXMgd2Ugd291bGQgZXhwZWN0LiBUaGlzIHRpbWUgd2UgaGF2ZTogdHdvIGxldmVscyBvZiBgU0VYYCwgdGhyZWUgbGV2ZWxzIG9mIGBSYWNlYCwgdGVuIGxldmVscyBvZiBgWUVBUmAsIGVpZ2h0ZWVuIGxldmVscyBvZiBgQUdFX0dST1VQYCwgYW5kIGZpZnR5IG9uZSBsZXZlbHMgb2YgYFNUQVRFYC4KCklmIHdlIG11bHRpcGx5IHRoZXNlIHRvZ2V0aGVyIHdlIGdldCA1NSwwODAsIHdoaWNoIGlzIHRoZSBzYW1lIGFzIHRoZSBudW1iZXIgb2Ygcm93cyBvZiB0aGUgZmluYWwgYGRlbV84MF84OWAgZGF0YS4gTG9va3MgZ29vZCEKCjxmb250IHNpemU9IjYiPiAqKjE5OTAtMTk5OSoqPC9mb250PgoKKioqCgpKdXN0IGxpa2UgdGhlIDgwcyB3ZSBuZWVkIHRvIGNvbWJpbmUgdGhlIGRhdGEgYWNyb3NzIHRoZSBmaWxlczoKCmBgYHtyfQpkZW1fOTBfOTkgPC0gZGVtXzkwXzk5ICU+JQogIG1hcF9kZihiaW5kX3Jvd3MpCmBgYAoKYGBge3J9CmdsaW1wc2UoZGVtXzkwXzk5KQpgYGAKRm9yIHRoaXMgZGVjYWRlIHRoZSBjb2x1bW4gbmFtZXMgY2FuJ3QgYWxsIGJlIGltcG9ydGVkIGluIGEgc2ltcGxlIHdheSBmcm9tIHRoZSB0YWJsZSwgc28gdGhleSBuZWVkIHRvIGJlIHJlY29kZWQuCgpIZXJlIGlzIHdoYXQgdGhlIGRhdGEgbG9va3MgbGlrZSBiZWZvcmUgaW1wb3J0aW5nOgoKYGBge3IsIGVjaG8gPSBGQUxTRSwgb3V0LndpZHRoID0gIjgwMCBweCJ9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmU6OmhlcmUoImltZyIsICI5MC5wbmciKSkKYGBgCgpTbywgZmlyc3QgdXNpbmcgdGhlIGJhc2UgYGNvbG5hbWVzKClgIGZ1bmN0aW9uIHdlIGNoYW5nZSB0aGUgbmFtZXMgb2YgdGhlIGNvbHVtbiBuYW1lcy4KCmBgYHtyfQoKY29sbmFtZXMoZGVtXzkwXzk5KSA8LSBjKCJZRUFSIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJTVEFURUZQIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJBZ2UiLAogICAgICAgICAgICAgICAgICAgICAgICAgIk5IX1dfTSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiTkhfV19GIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJOSF9CX00iLAogICAgICAgICAgICAgICAgICAgICAgICAgIk5IX0JfRiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiTkhfQUlBTl9NIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJOSF9BSUFOX0YiLAogICAgICAgICAgICAgICAgICAgICAgICAgIk5IX0FQSV9NIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJOSF9BUElfRiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiSF9XX00iLAogICAgICAgICAgICAgICAgICAgICAgICAgIkhfV19GIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJIX0JfTSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiSF9CX0YiLAogICAgICAgICAgICAgICAgICAgICAgICAgIkhfQUlBTl9NIiwKICAgICAgICAgICAgICAgICAgICAgICAgICJIX0FJQU5fRiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiSF9BUElfTSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAiSF9BUElfRiIpCgpnbGltcHNlKGRlbV85MF85OSkKYGBgCgpOb3RpY2UgYWxzbyB0aGF0IHRoZSBmaXJzdCByb3cgaXMgYWxsIGBOQWAgdmFsdWVzIGZyb20gd2hpdGUgc3BhY2UgaW4gdGhlIG9yZ2luYWwgdGFibGUgZm9yIDE5OTAsIHRoaXMgaXMgcHJvYmFibHkgdHJ1ZSBmb3IgZWFjaCB5ZWFyLiBXZSBjYW4gY2hlY2sgdGhlbSBkaW1lbnNpb25zIG9mIG91ciB0YWJsZSB1c2luZyB0aGUgYmFzZSBgZGltKClgIGZ1bmN0aW9uLiBXaGVuIHdlIGZpbHRlciBmb3Igcm93cyB3aGVyZSBgWUVBUmAgaXMgYE5BYCwgd2UgaW5kZWVkIHNlZSAxMCByb3dzLCB3aGljaCBpcyB3aGF0IHdlIHdvdWxkIGV4cGVjdCBpZiB3ZSBoYXZlIGEgcm93IGxpa2UgdGhpcyBmb3IgZWFjaCBvZiB0aGUgeWVhcnMgaW4gdGhlIGRlY2FkZS4gV2Ugc2VlIHRoZSBzYW1lIGlmIHdlIHRyeSBhIGRpZmZlcmVudCB2YXJpYWJsZS4gTm93IHdlIHdpbGwgdGVzdCB0byBzZWUgaG93IGxhcmdlIG91ciB0aWJibGUgaXMgaWYgd2UgZHJvcCByb3dzIHdpdGggYE5BYCB2YWx1ZXMgdXNpbmcgdGhlIGBkcm9wX25hKClgIGZ1bmN0aW9uIG9mIGB0aWR5cmAuIFdlIHRoYXQgaW5kZWVkIG91ciBkaW1lbnNpb25zIG9ubHkgY2hhbmdlZCBieSB0ZW4sIHNvIHRoZXJlIGFyZSBub3Qgb3RoZXIgcm93cyB3aXRoIG1pc3NpbmcgdmFsdWVzIHRoYXQgd2UgbWlnaHQgbm90IGV4cGVjdC4gU28gbm93IHdlIHdpbGwgcmVzaWduIHRoZSBgZGVtXzkwXzk5YCB2YXJpYWJsZSBhZnRlciByZW1vdmluZyB0aGVzZSByb3dzLgoKYGBge3J9CgpkaW0oZGVtXzkwXzk5KQoKZGVtXzkwXzk5ICU+JQogIGZpbHRlcihpcy5uYShZRUFSKSkKCmRlbV85MF85OSAlPiUKICBmaWx0ZXIoaXMubmEoQWdlKSkgCgpkZW1fOTBfOTkgJT4lZHJvcF9uYSgpIAoKZGVtXzkwXzk5ICU8PiVkcm9wX25hKCkgCmBgYAoKVGhlbiB3ZSBzdW0gYWNyb3NzIHRoZSBub25oaXNwYW5pYyBhbmQgaGlzcGFuaW5jIGdyb3VwcyBiZWNhdXNlIHRoaXMgaW5mb3JtYXRpb24gaXMgbm90IGF2YWlsYWJsZSBmb3IgdGhlIG90aGVyIHByZXZpb3VzIGRlY2FkZXMuIFRoZW4gd2Ugd2lsbCByZW1vdmUgdGhlIHZhcmlhYmxlcyBmb3IgdGhlIGhpc3BhbmljIGFuZCBub25oaXNwYW5pYyBzdWJncm91cHMgdXNpbmcgYHNlbGVjdCgpYC4KCmBgYHtyfQoKZGVtXzkwXzk5JTw+JQogICAgbXV0YXRlKFdfTSA9IE5IX1dfTSArIEhfV19NLAogICAgICAgICAgIFdfRiA9IE5IX1dfRiArIEhfV19GLAogICAgICAgICAgIEJfTSA9IE5IX0JfTSArIEhfQl9NLAogICAgICAgICAgIEJfRiA9IE5IX0JfRiArIEhfQl9GLAogICAgICAgICAgIEFJQU5fTSA9IE5IX0FJQU5fTSArIEhfQUlBTl9NLAogICAgICAgICAgIEFJQU5fRiA9IE5IX0FJQU5fRiArIEhfQUlBTl9GLAogICAgICAgICAgIEFQSV9NID0gTkhfQVBJX00gKyBIX0FQSV9NLAogICAgICAgICAgIEFQSV9GID0gTkhfQVBJX0YgKyBIX0FQSV9GKSAlPiUKICBzZWxlY3QoLXN0YXJ0c193aXRoKCJOSF8iKSwgLXN0YXJ0c193aXRoKCJIXyIpKQoKZ2xpbXBzZShkZW1fOTBfOTkpCmBgYAoKTG9va2luZyBiZXR0ZXIhIFdlIGFsc28gbmVlZCB0byBhZGQgYWdlIGdyb3VwcyBsaWtlIHRoZSBvdGhlciBkZWNhZGVzLiBXZSB3aWxsIHRha2UgYSBsb29rIGF0IHRoZSA4MHMgZGF0YSB1c2luZyB0aGUgYGRpc3RpbmN0KClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UgdG8gc2VlIHdoYXQgYWdlIGdyb3VwcyB3ZSBuZWVkLiBXZSBjYW4gdXNlIHRoZSBiYXNlIGBjdXQoKWAgZnVuY3Rpb24gdG8gY3JlYXRlIGEgbmV3IHZhcmlhYmxlIHdpdGggYG11dGF0ZSgpYCBjYWxsZWQgYEFHRV9HUk9VUGAgdGhhdCB3aWxsIGhhdmUgYSBsYWJlbCBmb3IgZXZlcnkgY2hhbmdlIGluIDUgeWVhcnMgb2YgYWdlLiBUaGUgYHJpZ2h0ID0gRkFMU0VgIGFyZ3VtZW50IHNwZWNpZmllcyB0aGF0IHRoZSBpbnRlcnZhbCBpcyBub3QgY2xvc2VkIG9uIHRoZSByaWdodCwgbWVhbmluZyB0aGF0IGlmIHRoZSB2YWx1ZSBpcyBhdCB0aGUgY3V0cG9pbnQgbGlrZSB0aGUgYEFnZWAgdmFsdWUgaXMgNSwgdGhlbiBpdCB3aWxsIGJlIGluIHRoZSBgNSB0byA5IHllYXJzYCBncm91cC4KCldlIGNhbiBtYWtlIHRoZSBsYWJlbHMgZm9yIHRoZSBgQUdFX0dST1VQYCB2YXJpYWJsZSBtYXRjaCB0aG9zZSBvZiBgZGVtXzc3Xzc5YCBidXQgd2UgbmVlZCB0byBwdWxsIG91dCB0aGUgdmFsdWVzIG9mIHRoZSB0aWJibGUgY3JlYXRlZCBieSBgZGlzdGluY3QoKWAuIFRvIGRvIHRoaXMgd2UgY2FuIHVzZSB0aGUgYHB1bGwoKWAgZnVuY3Rpb24gZnJvbSB0aGUgYGRwbHlyYCBwYWNrYWdlLiBOb3RlIHRoYXQgaXQgaXMgaW1wb3J0YW50IHRvIGNoZWNrIHRoYXQgdGhlIGBBR0VfR1JPVVBgIHZhbHVlcyBhcmUgbGlzdGVkIGluIG9yZGVyIGZvciBgZGVtXzc3Xzc5YC4gV2Ugd2lsbCBhbHNvIHJlbW92ZSB0aGUgYEFnZWAgdmFyaWFibGUgYWZ0ZXIgd2UgY3JlYXRlIHRoZSBuZXcgYEFHRV9HUk9VUGAgdmFyaWFibGUgZm9yIHRoZSBgZGVtXzkwXzk5YCBkYXRhLiAKCgpgYGB7cn0KCmRpc3RpbmN0KGRlbV83N183OSwgQUdFX0dST1VQKQpwdWxsKGRpc3RpbmN0KGRlbV83N183OSwgQUdFX0dST1VQKSkKCmRlbV85MF85OSAlPD4lCiAgbXV0YXRlKEFHRV9HUk9VUCA9IGN1dChBZ2UsCiAgICAgICAgICAgICAgICAgICAgICAgICBicmVha3MgPSBzZXEoMCw5MCwgYnk9NSksCiAgICAgICAgICAgICAgICAgICAgICAgICByaWdodCA9IEZBTFNFLCBsYWJlbHMgPSBwdWxsKGRpc3RpbmN0KGRlbV83N183OSxBR0VfR1JPVVApLCBBR0VfR1JPVVApKSkgJT4lCiAgc2VsZWN0KC1BZ2UpCgpnbGltcHNlKGRlbV85MF85OSkKCmBgYAoKTGlrZSB0aGUgcHJldmlvdXMgZGVjYWRlcyB3ZSB3aWxsIGNyZWF0ZSBhIGBSQUNFYCBhbmQgYFNVQl9QT1BgIHZhcmlhYmxlIHVzaW5nIGBwaXZvdF9sb25nZXIoKWAgdG8gY3JlYXRlIGEgc2luZ2xlIGBSYWNlYCB2YXJpYWJsZSBvdXQgb2YgYWxsIHRoZSBzdWJncm91cCB2YXJpYWJsZXMuIAoKTm93IHdlIG5lZWQgdG8gY29sbGFwc2UgdGhlIGRhdGEgZm9yIHRoZSB2YXJpb3VzIHJhY2VzIHNvIHRoYXQgaXQgbWF0Y2hlcyB0aGUgcHJldmlvdXMgZGVjYWRlcy4gVGhpcyB0aW1lIHdlIHdpbGwgdXNlIHRoZSBgY2FzZV93aGVuKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UgYW5kIHRoZSBgc3RyX2RldGVjdCgpYCBmdW5jdGlvbiBvZiB0aGUgYHN0cmluZ3JgIHBhY2thZ2UgdG8gaWRlbnRpZnkgd2hlbiB0aGUgcmFjZSBpcyBzb21ldGhpbmcgb3RoZXIgdGhhbiBgQmAgb3IgYFdgIGFuZCByZXBsYWNlIHdpdGggdGhlIHZhbHVlIGBPdGhlcmAuIFRoZSB2YWx1ZSB0byB0aGUgcmlnaHQgb2YgdGhlIGB+YCBpbmRpY2F0ZXMgd2hhdCB3ZSB3YW50IHRoZSB2YWx1ZSBvZiB0aGUgbmV3IHZhcmlhYmxlIHRvIGJlIGlmIHRoZSB2YWx1ZSBvZiB0aGUgdmFyaWFibGUgd2UgYXJlIHVzaW5nIHdpdGggYHN0cl9kZWNlY3QoKWAgbWF0Y2hlcyB0aGUgY29uZGl0aW9uIHNwZWNpZmllZC4gSWYgdGhlIHZhbHVlIGRvZXMgbm90IG1hdGNoIHRoZSBzcGVjaWZpZWQgY29uZGl0aW9uLCB0aGFuIHRoZSBvdGhlciB2YWx1ZXMgd2lsbCBiZSB3aGF0IGV2ZXIgaXMgbGlzdGVkIGFmdGVyIGBUUlVFIH5gLiBXZSB3aWxsIHRoZW4gY3JlYXRlIHBvcHVsYXRpb24gY291bnRzIGFzIHdlIGRpZCBwcmV2aW91c2x5IGZvciB0aGUgb3RoZXIgZGVjYWRlcy4KCkZpbmFsbHksIHdlIHdpbGwgY3JlYXRlIG5ldyBzdW1zIGZvciB0aGUgc3VicG9wdWxhdGlvbnMgd2hlcmUgd2Ugc3VtIGFjcm9zcyB0aGUgdHdvIGBPdGhlcmAgc3ViZ3JvdXBzIGBSYWNlYCAgdG8gYSBjcmVhdGUgYSBzaW5nbGUgdmFsdWUgZm9yIGVhY2ggdmFsdWUgb2YgYFlFQVJgLCBgU0VYYCwgYEFHRV9HUk9VUGAsIGFuZCBgU1RBVEVgIGJ5IHVzaW5nIHRoZSBgZ3JvdXBfYnkoKWAgZnVuY3Rpb24gYW5kIGBzdW1tYXJpZSgpYC4gIAoKYGBge3J9CmRlbV85MF85OSAgJTw+JQogIHBpdm90X2xvbmdlcihjb2xzID0gYyhzdGFydHNfd2l0aCgiV18iKSwKICAgICAgICAgICAgICAgICAgICBzdGFydHNfd2l0aCgiQl8iKSwKICAgICAgICAgICAgICAgICAgICBzdGFydHNfd2l0aCgiQUlBTl8iKSwKICAgICAgICAgICAgICAgICAgICBzdGFydHNfd2l0aCgiQVBJXyIpKSwKICAgICAgICAgICAgICAgbmFtZXNfdG8gPSAiUkFDRSIsCiAgICAgICAgICAgICAgIHZhbHVlc190byA9ICJTVUJfUE9QX3RlbXAiKQoKZGVtXzkwXzk5ICU8PiUKICBtdXRhdGUoU0VYID0gY2FzZV93aGVuKHN0cl9kZXRlY3QoUkFDRSwgIl9NIikgfiAiTWFsZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICBUUlVFIH4gIkZlbWFsZSIpLAogICAgICAgICBSQUNFID0gY2FzZV93aGVuKHN0cl9kZXRlY3QoUkFDRSwgIldfIikgfiAiV2hpdGUiLAogICAgICAgICAgICAgICAgICAgICAgICAgIHN0cl9kZXRlY3QoUkFDRSwgIkJfIikgfiAiQmxhY2siLAogICAgICAgICAgICAgICAgICAgICAgICAgIFRSVUUgfiAiT3RoZXIiKSkgJT4lCiAgbGVmdF9qb2luKFNUQVRFX0ZJUFMsIGJ5ID0gIlNUQVRFRlAiKSAlPiUKICBkcGx5cjo6c2VsZWN0KC1TVEFURUZQKQoKZGVtXzkwXzk5ICU8PiUKICBncm91cF9ieShZRUFSLCBTVEFURSwgQUdFX0dST1VQLCBTRVgsIFJBQ0UpICU+JQogIHN1bW1hcmlzZShTVUJfUE9QID0gc3VtKFNVQl9QT1BfdGVtcCksIC5ncm91cHM9ImRyb3AiKQoKYGBgCgpgYGB7cn0KcG9wXzkwXzk5IDwtIGRlbV85MF85OSAlPiUKICBncm91cF9ieShZRUFSLCBTVEFURSkgJT4lCiAgc3VtbWFyaXNlKFRPVF9QT1AgPSBzdW0oU1VCX1BPUCksIC5ncm91cHMgPSAiZHJvcCIpCgpkZW1fOTBfOTkgPC0gZGVtXzkwXzk5ICU+JQogIGxlZnRfam9pbihwb3BfOTBfOTksIGJ5PWMoIllFQVIiLCAiU1RBVEUiKSkgJT4lCiAgbXV0YXRlKFBFUkNfU1VCX1BPUCA9IChTVUJfUE9QL1RPVF9QT1ApKjEwMCkgJT4lCiAgZHBseXI6OnNlbGVjdCgtU1VCX1BPUCwgLVRPVF9QT1ApCgpkZW1fOTBfOTkKYGBgCgoKQWdhaW4sIHdlIHNob3VsZCBjaGVjayB0byBtYWtlIHN1cmUgdGhhdCB3ZSBoYXZlIHRoZSB0b3RhbCB2YWx1ZXMgd2Ugd291bGQgZXhwZWN0LiBXZSBoYXZlIHRoZSBzYW1lIG51bWJlciBvZiB1bmlxdWUgdmFsdWVzIGZvciBlYWNoIG9mIG91ciB2YXJpYWJsZXMgYXMgaW4gd2l0aCB0aGUgZGF0YSBmcm9tIHRoZSA4MHMsIHNvIGlmIHdlIGNvbGxwYXNlZCB0aGUgZGF0YSBmb3IgdGhlIGRpZmZlcmVudCBhZGRpdGlvbmFsIHN1YnBvcHVsYXRpb25zIGluIHRoaXMgZGF0YSwgdGhlbiB3ZSBoYXZlIGRvbmUgaXQgY29ycmVjdGx5LiAKCkluZGVlZCBpdCBsb29rcyBsaWtlIHdlIGhhdmUgNTUsMDgwIHJvd3MsIHdoaWNoIGlzIHdoYXQgd2Ugd291bGQgZXhwZWN0IGFuZCBpcyB0aGUgc2FtZSBhcyB0aGUgbnVtYmVyIG9mIHJvd3Mgb2YgdGhlIGZpbmFsIGBkZW1fODBfODlgIGRhdGEuIExvb2tzIGdvb2QhCgo8Zm9udCBzaXplPSI2Ij4gKioyMDAwLTIwMTAqKjwvZm9udD4KCioqKgoKQWdhaW4sIGZvciB0aGlzIGRlY2FkZSB3ZSBuZWVkIHRvIGNvbWJpbmUgdGhlIGRhdGEgYWNyb3NzIHllYXJzLgoKYGBge3J9CmRlbV8wMF8xMCA8LSBkZW1fMDBfMTAgJT4lCiAgbWFwX2RmKGJpbmRfcm93cykKCmdsaW1wc2UoZGVtXzAwXzEwKQoKYGBgCgpPaywgdGhlIGRhdGEgbG9va3MgYSBiaXQgZGlmZmVyZW50IGZyb20gdGhlIG90aGVycy4gRmlyc3Qgd2Ugd2lsbCByZW1vdmUgYSBjb3VwbGUgb2YgdmFyaWFibGVzIHRoYXQgd2UgcHJvYmFibHkgZG9uJ3QgbmVlZC4gQWxzbyBpdCBsb29rcyBsaWtlIHdlIGhhdmUgc29tZSB2YWx1ZXMgZm9yIHRoZSBlbnRpcmUgVW5pdGVkIFNhdGVzIGFuZCB3ZSB3aWxsIGRyb3AgdGhlc2UgdG8gYmUgbGlrZSB0aGUgb3RoZXIgZGVjYWRlcy4KCgoKYGBge3J9CmRlbV8wMF8xMCAlPD4lCiAgc2VsZWN0KC1FU1RJTUFURVNCQVNFMjAwMCwtQ0VOU1VTMjAxMFBPUCkgJT4lCiAgZmlsdGVyKE5BTUUgIT0gIlVuaXRlZCBTdGF0ZXMiKQpgYGAKCldlIGNhbiBzZWUgdGhhdCB0aGVyZSBhcmUgbG90cyBvZiB2YWx1ZXMgdGhhdCBhcmUgemVyby4gQWNjb3JkaW5nIHRvIHRoZSBbdGVjaG5pY2FsIGRvY3VtZW50YXRpb25dKGh0dHBzOi8vd3d3Mi5jZW5zdXMuZ292L3Byb2dyYW1zLXN1cnZleXMvcG9wZXN0L3RlY2huaWNhbC1kb2N1bWVudGF0aW9uL2ZpbGUtbGF5b3V0cy8yMDAwLTIwMTAvaW50ZXJjZW5zYWwvc3RhdGUvc3QtZXN0MDBpbnQtYWxsZGF0YS5wZGYpe3RhcmdldD0iX2JsYW5rIn0gZm9yIHRoaXMgZGF0YSwgemVybyB2YWx1ZXMgaW5kaWNhdGUgdGhlIHRvdGFsIGZvciB0aGUgb3RoZXIgY2F0ZWdvcmllcyBvZiBgU2V4YCwgYE9yaWdpbmAsIGBSYWNlYCwgYW5kIGBBR0VHUlBgLgoKCmBgYHtyLCBlY2hvID0gRkFMU0UsIG91dC53aWR0aCA9ICI2MDAgcHgifQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlOjpoZXJlKCJpbWciLCAidGVjaF9pbmZvLnBuZyIpKQpgYGAKClNvIHdlIHdpbGwgZHJvcCB0aGUgdG90YWwgdmFsdWVzIGZvciBgU0VYYCwgYFJBQ0VgLCBhbmQgYEFHRUdSUGAgYnkgcmVtb3ZpbmcgdGhlIHJvd3Mgd2hlcmUgdGhlc2UgdmFyaWFibGVzIGFyZSBlcXVhbCB0byB6ZXJvLgoKV2Ugd2lsbCBhbHNvIHdhbnQgdG8gb25seSBzZWxlY3QgZm9yIHRoZSB0b3RhbCB2YWx1ZXMgZm9yIGBPcmlnaW5gIGFzIHdlIGRvIG5vdCB3aXNoIHRvIGRpdmlkZSB0aGUgZGF0YSBpbnRvIHN1Ymdyb3VwcyBhYm91dCBoaXNwYW5pYyBldGhuaWNpdHkgYmVjYXVzZSB3ZSBkbyBub3QgaGF2ZSB0aGF0IGluZm9ybWF0aW9uIGZvciB0aGUgZmlyc3QgdHdvIGRlY2FkZXMuIFRodXMgd2Ugd2lsbCBmaWx0ZXIgZm9yIG9ubHkgdGhlIHJvd3Mgd2hlcmUgYE9yaWdpbmAgaXMgZXF1YWwgdG8gemVyby4KCldlIHdpbGwgYWxzbyB0aGVuIHJlbW92ZSB0aGUgYFJFR0lPTmAsIGBEaXZpc2lvbmAsIGBTVEFURWAsIGFuZCBgT3JpZ2luYCB2YXJpYWJsZXMuIFdlIHdpbGwgdGhlbiByZW5hbWUgYE5BTUVgIHRvIGJlIGBTVEFURWAgYW5kIHJlbmFtZSBgQUdFR1JQYCB0byBiZSBsaWtlIHRoZSBvdGhlciBkZWNhZGVzIGFzIGBBR0VfR1JPVVBgLgoKYGBge3J9CmRlbV8wMF8xMCAlPD4lCiAgZmlsdGVyKFNFWCAhPSAwLAogICAgICAgICBSQUNFICE9IDAsCiAgICAgICAgIEFHRUdSUCAhPSAwLCAKICAgICAgICAgT1JJR0lOID09IDApICU+JQogIGRwbHlyOjpzZWxlY3QoLVJFR0lPTiwgLURJVklTSU9OLCAtT1JJR0lOLCAtU1RBVEUpICU+JQogIHJlbmFtZSgiU1RBVEUiID0gTkFNRSwKICAgICAgICAgIkFHRV9HUk9VUCIgPSBBR0VHUlApCgpkZW1fMDBfMTAKYGBgCgoKTm93IHdlIG5lZWQgdG8gcmVjb2RlIHRoZSBudW1lcmljIHZhbHVlcyB0byB0aGUgdmFsdWVzIGluIHRoZSB0ZWNoaW5jYWwgZG9jdW1lbnRhdGlvbi4gV2UgY2FuIGRvIHNvIGJ5IGFkZGluZyBsYWJlbHMgdG8gZWFjaCBudW1lcmljIGxldmVsIHVzaW5nIHRoZSBiYXNlIGZ1bmN0aW9uIGBmYWN0b3IoKWAuCgpgYGB7cn0KZGVtXzAwXzEwICU8PiUKICBtdXRhdGUoU0VYID0gZmFjdG9yKFNFWCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxldmVscyA9IDE6MiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxhYmVscyA9IGMoIk1hbGUiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiRmVtYWxlIikpLAogICAgICAgICBSQUNFID0gZmFjdG9yKFJBQ0UsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZXZlbHMgPSAxOjYsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsYWJlbHMgPSBjKCJXaGl0ZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJCbGFjayIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHJlcCgiT3RoZXIiLDQpKSksCiAgICAgICAgIEFHRV9HUk9VUCA9IGZhY3RvcihBR0VfR1JPVVAsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZXZlbHMgPSAxOjE4LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbGFiZWxzID0gcHVsbChkaXN0aW5jdChkZW1fNzdfNzksQUdFX0dST1VQKSwgQUdFX0dST1VQKSkpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAKZ2xpbXBzZShkZW1fMDBfMTApCmBgYAoKT0ssIHdlIGFsc28gd2FudCB0byBjaGFuZ2UgdGhlIHNoYXBlIG9mIHRoZSBkYXRhIHNvIHRoYXQgd2UgaGF2ZSBhIGBZRUFSYCB2YXJpYWJsZSBhbmQgZWFjaCBlc3RpbWF0ZSBvZiB0aGUgcG9wdWxhdGlvbiBpcyBhIHZhbHVlIGluIGEgbmV3IHZhcmlhYmxlIGNhbGxlZCBgU1VCX1BPUF90ZW1wYC4gCgpgYGB7cn0KZGVtXzAwXzEwICU8PiUKICBwaXZvdF9sb25nZXIoY29scz1jb250YWlucygiRVNUSU1BVEUiKSwKICAgICAgICAgICAgICAgbmFtZXNfdG8gPSAiWUVBUiIsCiAgICAgICAgICAgICAgIHZhbHVlc190byA9ICJTVUJfUE9QX3RlbXAiKQpgYGAKCldlIHdpbGwgbm93IGNsZWFuIHVwIHRoZSBgWUVBUmAgdmFyaWFibGUgdG8gb25seSBiZSB0aGUgbnVtZXJpYyB2YWx1ZSBieSBrZWVwaW5nIG9ubHkgdGhlIGxhc3QgNCB2YWx1ZXMgb2YgZWFjaCBzdHJpbmcgdXNpbmcgdGhlIGBzdHJfc3ViKClgIGZ1bmN0aW9uIG9mIHRoZSBgc3RyaW5ncmAgcGFja2FnZS4KCmBgYHtyfQpkZW1fMDBfMTAgJTw+JQogIG11dGF0ZShZRUFSID0gc3RyX3N1YihZRUFSLCBzdGFydD0tNCkpICU+JQogIG11dGF0ZShZRUFSID0gYXMubnVtZXJpYyhZRUFSKSkKYGBgCgoKTm93IHdlIHdpbGwgY29sbGFwc2UgdGhlIGRhdGEgZm9yIHRoZSBkaWZmZXJlbnQgUkFDRVMgYW5kIGNhbGN1bGF0ZSBhIG5ldyBgU1VCX1BPUGAgdmFsdWUuIAoKYGBge3J9CmRlbV8wMF8xMCAlPD4lCiAgZ3JvdXBfYnkoWUVBUiwgQUdFX0dST1VQLCBTVEFURSwgU0VYLCBSQUNFKSAlPiUKICBzdW1tYXJpc2UoU1VCX1BPUCA9IHN1bShTVUJfUE9QX3RlbXApLCAuZ3JvdXBzID0gImRyb3AiKQpgYGAKCkFnaWFuLCB0aGUgZGltZW5zaW9ucyBsb29rIGFzIHdlIGV4cGVjdCB3aXRoIDYwLDU4OCByb3dzLiBUaGlzIHRpbWUgd2UgaGF2ZSB0d28gbGV2ZWxzIG9mIGBTRVhgLCB0aHJlZSBsZXZlbHMgb2YgYFJhY2VgLCAqKjExKiogbGV2ZWxzIG9mIGBZRUFSYCwgZWlnaHRlZW4gbGV2ZWxzIG9mIGBBR0VfR1JPVVBgLCBhbmQgZmlmdHkgb25lIGxldmVscyBvZiBgU1RBVEVgLiBJZiB3ZSBtdWx0aXBseSB0aGlzIHRvZ2V0aGVyIHdlIGdldCAxNiw1ODguIExvb2tzIGdvb2QhCgpOb3cgd2Ugd2lsbCBjYWxjdWxhdGUgdGhlIHRvdGFsIHBvbHV0YXRpb24gYW5kIHBlcmNlbnQgb2YgdGhlIHRvdGFsIGFzIHdlIGhhdmUgZG9uZSB3aXRoIHRoZSBwcmV2aW91cyBkZWNhZGVzLgoKCmBgYHtyfQpwb3BfMDBfMTAgPC0gZGVtXzAwXzEwICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFKSAlPiUKICBzdW1tYXJpc2UoVE9UX1BPUCA9IHN1bShTVUJfUE9QKSwgLmdyb3VwcyA9ICJkcm9wIikKYGBgCgpXZSBjYW4gYWxzbyBjaGVjayB0aGF0IG91ciB3cmFuZ2xpbmcgd2FzIHBlcmZvcm1lY2QgY29ycmVjdGx5IGJ5IHN1bW1pbmcgdGhlIHZhbHVlcyBmb3IgdGhlIGluZGl2aWR1YWwgc3VicG9wdWxhdGlvbnMgcGVyY2VudGFnZXMgYW5kIHNlZWluZyBpZiBpdCB0b3RhbHMgdG8gMTAwLgoKYGBge3J9CmRlbV8wMF8xMCAlPiUKICBsZWZ0X2pvaW4ocG9wXzAwXzEwLCBieT1jKCJZRUFSIiwgIlNUQVRFIikpICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFKSAlPiUKICBtdXRhdGUoUEVSQ19TVUJfUE9QID0gKFNVQl9QT1AvVE9UX1BPUCkqMTAwKSAlPiUKICBzdW1tYXJpc2UocGVyY190b3QgPSBzdW0oUEVSQ19TVUJfUE9QKSwgLmdyb3VwcyA9ICJkcm9wIikgJT4lCiAgbXV0YXRlKHBvc3NfZXJyb3IgPSBjYXNlX3doZW4oYWJzKHBlcmNfdG90IC0gMTAwKSA+IDAgfiBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFRSVUUgfiBGQUxTRSkpICU+JQogIGdyb3VwX2J5KHBvc3NfZXJyb3IpICU+JQogIHRhbGx5KCkKCmBgYAoKTG9va3MgbGlrZSB0aGUgcGVyY2VudGFnZXMgZm9yIGVhY2ggc3RhdGUgZm9yIGVhY2ggeWVhciBhbGwgYWRkIHVwIHRvIDEwMCwgYXMgd2Ugd291bGQgZXhwZWN0LiBHcmVhdCEgTm93IHdlIHdpbGwgcmVhc2lnbiB0aGUgYGRlbV8wMF8xMGAgZGF0YSB3aXRoIHRoaXMgcHJvY2Vzc2luZy4gCgpgYGB7cn0KZGVtXzAwXzEwICU8PiUKICBsZWZ0X2pvaW4ocG9wXzAwXzEwLCBieSA9IGMoIllFQVIiLCAiU1RBVEUiKSkgJT4lCiAgbXV0YXRlKFBFUkNfU1VCX1BPUCA9IChTVUJfUE9QL1RPVF9QT1ApKjEwMCkgJT4lCiBzZWxlY3QoLVNVQl9QT1AsIC1UT1RfUE9QKQoKZGVtXzAwXzEwCmBgYAoKT0ssIG5vdyB3ZSBhcmUgcmVhZHkgdG8gY29tYmluZSBhbGwgb2Ygb3VyIGRlbWdyYXBoaWMgZGF0YSB0b2dldGhlciEKCjwhLS0gPC9kZXRhaWxzPiAtLT4KCiMjIENvbWJpbmluZyBkZW1vZ3JhcGhpYyBkYXRhCgpXZSBjYW4gY2hlY2sgdGhhdCB0aGUgY29sbmFtZXMgYXJlIHRoZSBzYW1lIGZvciB0aGUgZGF0YSBmb3IgZWFjaCBvZiB0aGUgZGVjYWRlcyBieSB1c2luZyB0aGUgYHNldGVxdWFsKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UuCgpgYGB7cn0Kc2V0ZXF1YWwoY29sbmFtZXMoZGVtXzc3Xzc5KSxjb2xuYW1lcyhkZW1fODBfODkpKQpzZXRlcXVhbChjb2xuYW1lcyhkZW1fODBfODkpLGNvbG5hbWVzKGRlbV85MF85OSkpCnNldGVxdWFsKGNvbG5hbWVzKGRlbV85MF85OSksY29sbmFtZXMoZGVtXzAwXzEwKSkKYGBgCgoKV2UgY2FuIGFsc28gY29uZmlybSB0aGF0IHdlIGhhdmUgdGhlIHNhbWUgbnVtYmVyIG9mIGFnZSBncm91cHMgZm9yIGVhY2ggZGVjYWRlIGJ5IHVzaW5nIHRoZSBiYXNlIGBsZW5ndGgoKWAgZnVuY3Rpb24uIElmIHlvdSBkaWQgbm90IHRha2UgYSBsb29rIGF0IHRoZSB3cmFuZ2xpbmcgZm9yIHRoZSBkZW1vZ3JhcGhpYyBkYXRhIHRoZW4geW91IG1heSBiZSB1bmZhbWlsaWFyIHdpdGggdGhlIGBwdWxsKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UuIFRoaXMgYWxsb3dzIHlvdSB0byBncmFiIHRoZSB2YWx1ZXMgb2YgYSB2YXJpYWJsZSBmcm9tIGEgdGliYmxlLiBUaGUgYGRpc3RpbmN0KClgIGZ1bmN0aW9uIHdoaWNoIGlzIGFsc28gb2YgdGhlIGBkcGx5cmAgcGFja2FnZSBjcmVhdGVzIGEgdGliYmxlIG9mIHRoZSB1bmlxdWUgdmFsdWVzIGZvciBhIHZhcmlhYmxlLgoKYGBge3J9Cmxlbmd0aChwdWxsKGRpc3RpbmN0KGRlbV83N183OSwgQUdFX0dST1VQKSwgQUdFX0dST1VQKSkKbGVuZ3RoKHB1bGwoZGlzdGluY3QoZGVtXzgwXzg5LCBBR0VfR1JPVVApLCBBR0VfR1JPVVApKQpsZW5ndGgocHVsbChkaXN0aW5jdChkZW1fOTBfOTksIEFHRV9HUk9VUCksIEFHRV9HUk9VUCkpCmxlbmd0aChwdWxsKGRpc3RpbmN0KGRlbV8wMF8xMCwgQUdFX0dST1VQKSwgQUdFX0dST1VQKSkKYGBgCgpMb29rcyBnb29kIQoKCk5vdyB3ZSB3aWxsIGNvbWJpbmUgdGhlIGRhdGEgdXNpbmcgdGhlIGBiaW5kX3Jvd3MoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gVGhpcyBmdW5jdGlvbiBhcHBlbmRzIHRoZSBkYXRhIHRvZ2V0aGVyIGJhc2VkIG9uIHRoZSBwcmVzZW5jZSBvZiBjb2x1bW5zIHdpdGggdGhlIHNhbWUgbmFtZSBpbiB0aGUgZGlmZmVyZW50IHRpYmJsZXMuCgpgYGB7cn0KZGVtIDwtIGJpbmRfcm93cyhkZW1fNzdfNzksCiAgICAgICAgICAgICAgICAgZGVtXzgwXzg5LAogICAgICAgICAgICAgICAgIGRlbV85MF85OSwKICAgICAgICAgICAgICAgICBkZW1fMDBfMTApCmBgYAoKCmBgYHtyfQpnbGltcHNlKGRlbSkKYGBgCgpHcmVhdCEgbm93IHdlIGhhdmUgYSByZWFsbHkgbGFyZ2Ugc2luZ2xlIHRpYmJsZS4KCk5vdyB3ZSB3YW50IHRvIHNlbGVjdCBzaW1pbGFyIGRlbW9ncmFwaGljIGRhdGEgdG8gd2hhdCB3YXMgdXNlZCBpbiB0aGUgcHJldmlvdXMgYW5hbHlzZXMuCgpIZXJlIGlzIHRoZSB0YWJsZSBmcm9tIHRoZSBbRG9ub2h1ZSBwYXBlcl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpe3RhcmdldD0iX2JsYW5rIn0gdGhhdCBjb21wYXJlcyB0aGUgZGF0YSB1c2VkIGluIHRoZSBhbmFseXNlcy4KCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsJ0Rvbm9odWVfVGFibGUyLnBuZycpKQpgYGAKV2UgY2FuIHNlZSB0aGF0IG9ubHkgdGhlIHBlcmNlbnRhZ2Ugb2YgbWFsZXMgdGhhdCB3ZXJlIGZyb20gYWdlIDE1LTM5IG9mIHRoZSByYWNlIGdyb3VwcyAoYmxhY2ssIHdoaXRlLCBhbmQgb3RoZXIpIHdlcmUgdXNlZCBpbiB0aGUgRG9ub2h1ZSBhbmFseXNpcy4KClVsdGltYXRlbHkgd2UgaW50ZW5kIHRvIG1ha2UgYSB0aWJibGUgb2YgZGF0YSB0aGF0IGlzIHNpbWlsYXIgdG8gZWFjaCBhbmFseXNpcy4gVGhlcmVmb3JlLCB3ZSB3aWxsIGNyZWF0ZSBhIGRhdGEgdGliYmxlIGFib3V0IHRoZSBkZW1vZ3JwaGFpYyBkYXRhIGZvciBlYWNoIGFuYWx5c2lzIG5vdy4KClRvIGRvIHNvIHdlIHdpbGwgZmlyc3QgY3JlYXRlIGEgdmVjdG9yIG9mIHRoZSBhZ2UgZ3JvdXBzIHRoYXQgc2hvdWxkIGJlIGluY2x1ZGVkIGluIHRoZSBEb25vaHVlLWxpa2UgYW5hbHlzaXMsIHRoYXQgd2Ugd2lsbCBjYWxsIGBET05PSFVFX0FHRV9HUk9VUFNgLiBXZSB3aWxsIHRoZW4gZmlsdGVyIGZvciBvbmx5IHRoZSBhZ2UgZ3JvdXBzIGluIHRoaXMgdmVjdG9yIGJ5IHVzaW5nIHRoZSBgZmlsdGVyKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UgYW5kIHRoZSBgJWluJWAgb3BlcmF0b3IgdG8gaW5kaWNhdGUgdGhhdCB3ZSB3YW50IHRvIGtlZXAgYWxsIGBBR0VfR1JPVVBgIHZhbHVlcyB0aGF0IGFyZSBlcXVhbCB0byB0aG9zZSB3aXRoaW4gYERPTk9IVUVfQUdFX0dST1VQU2AuIFdlIGFsc28gd2FudCB0byBmaWx0ZXIgZm9yIG9ubHkgcG9wdWxhdGlvbiBwZXJjZW50YWdlcyBmb3IgbWFsZXMgYnkgdXNpbmcgdGhlIGA9PWAgb3BlcmF0b3IuIFRoZW4gd2UgY2FuIGNvbGxwYXNlIHRoZSBhZ2UgZ3JvdXBzIGZyb20gMjAtMzkgYnkgdXNpbmcgdGhlIGBmY3RfY29sbHBhc2UoKWAgZnVuY3Rpb24gb2YgdGhlIGBmb3JjYXRzYCBwYWNrYWdlLgoKYGBge3J9CkRPTk9IVUVfQUdFX0dST1VQUyA8LSBjKCIxNSB0byAxOSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICIyMCB0byAyNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICIyNSB0byAyOSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICIzMCB0byAzNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICIzNSB0byAzOSB5ZWFycyIpCgpkZW1fRE9OT0hVRSA8LSBkZW0gJT4lCiAgZmlsdGVyKEFHRV9HUk9VUCAlaW4lIERPTk9IVUVfQUdFX0dST1VQUywKICAgICAgICAgICAgICAgU0VYID09ICJNYWxlIikgJT4lCiAgbXV0YXRlKEFHRV9HUk9VUCA9IGZjdF9jb2xsYXBzZShBR0VfR1JPVVAsICIyMCB0byAzOSB5ZWFycyI9YygiMjAgdG8gMjQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjI1IHRvIDI5IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIzMCB0byAzNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMzUgdG8gMzkgeWVhcnMiKSkpCgpkZW1fRE9OT0hVRQpgYGAKCldlIGFsc28gd2FudCB0byBjcmVhdGUgYSBuZXcgdmFyaWFibGUgdGhhdCB3aWxsIGNvbnRhaW4gYWxsIHRoZSBkZW1vZ3JhcGhpYyBpbmZvcm1hdGlvbiBmb3IgZWFjaCBwZXJjZW50YWdlIGp1c3QgYXMgd2FzIGRvbmUgaW4gdGhlIFtEb25vaHVlLCBldCBhbC5dKGh0dHBzOi8vd3d3Lm5iZXIub3JnL3BhcGVycy93MjM1MTAucGRmKXt0YXJnZXQ9Il9ibGFuayJ9IGFuYWx5c2lzLiBUaGlzIHNob3VsZCByZXN1bHQgaW4gNiBkaWZmZXJlbnQgZGVtb2dyYXBoaWMgdmFyaWFibGVzLgoKVG8gZG8gdGhpcyB3ZSB3aWxsIG1vZGlmeSB0aGUgYEFHRV9HUk9VUGAgdmFyaWFibGUgYnkgdXNpbmcgdGhlIGBtdXRhdGUoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gV2Ugd2lsbCByZXBsYWNlIHRoZSBzcGFjZXMgaW4gdGhlIG5vdyB0d28gYWdlIGdyb3VwIGNhdGVnb3Jpc2Ugd2l0aCBhbmQgdW5kZXNyc2NvcmUgdXNpbmcgdGhlIGBzdHJfcmVwbGFjZV9hbGwoKWAgZnVuY3Rpb24gb2YgdGhlIGBzdHJpbmdyYCBwYWNrYWdlIHdoaWNoIHJlcGxhY2VzIGFsbCBpbnN0YW5jZXMgb2YgYSBwYXR0ZXJuIGluIGEgY2hhcmFjdGVyIHN0cmluZy4gCgpUaGVuIHdlIHdpbGwgdXNlIHRoZSBgZ3JvdXBfYnkoKWAgZnVuY3Rpb24gYW5kIHRoZSBgc3VtbWFyaXNlKClgIGZ1bnRpb24gYWxzbyBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlIHRvIGFsbG93IHVzIHRvIGNhbGN1bGF0ZSBhIHN1bSBvZiB0aGUgcGVyY2VudGFnZXMgZm9yIGVhY2ggb2YgdGhlIHN1YnBvcHVsYXRpb24gcGVyY2VudGFnZXMgZm9yIHRoZSBuZXdseSBtb2RpZmVkIGFnZSBncm91cHMgaW4gYEFHRV9HUk9VUGAuIFRoZSBgLmdyb3VwcyA9ICJkcm9wImAgYXJndW1lbnQgYWxsb3dzIGZvciB0aGUgZ3JvdXBpbmcgdG8gYmUgcmVtb3ZlZCBhZnRlciB0aGUgYHN1bW1hcmlzZSgpYCBmdW5jdGlvbi4KCmBgYHtyfQpkZW1fRE9OT0hVRSAlPD4lCiAgbXV0YXRlKEFHRV9HUk9VUCA9IHN0cl9yZXBsYWNlX2FsbChzdHJpbmcgPSBBR0VfR1JPVVAsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGF0dGVybiA9ICIgIiwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICByZXBsYWNlbWVudCA9ICJfIikpICU+JQogIGdyb3VwX2J5KFlFQVIsIFNUQVRFLCBSQUNFLCBTRVgsIEFHRV9HUk9VUCkgJT4lCiAgc3VtbWFyaXNlKFBFUkNfU1VCX1BPUCA9IHN1bShQRVJDX1NVQl9QT1ApLCAuZ3JvdXBzID0gImRyb3AiKQoKZGVtX0RPTk9IVUUKYGBgCgpOb3cgd2Ugd2lsbCBjb21iaW5lIHRoZSB2YXJpYWJsZXMgYFJBQ0VgLCBgU0VYYCwgYW5kIGBBR0VfR1JPVVBgIHRvZ2V0aGVyIGludG8gb25lIHN0cmluZyBzZXBhcmF0ZWQgYnkgdW5kZXJzY29yZXMgdXNpbmcgdGhlIGB1bml0ZWAgZnVuY3Rpb24gb2YgdGhlIGB0aWR5cmAgcGFja2FnZS4gd2Ugd2lsbCBjYWxsIHRoaXMgbmV3IHZhcmlhYmxlIGBWQVJJQUJMRWAuCldlIHdpbGwgcmVuYW1lIHRoZSBgUEVSQ19TVUJfUE9QYCB2YXJpYWJsZSB0byBiZSBgVkFMVUVgIHVzaW5nIHRoZSBgcmVuYW1lKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UuIFRoZSBuZXcgbmFtZSBzaG91bGQgYmUgbGlzdGVkIGZpcnN0IGJlZm9yZSB0aGUgYD1gLgoKYGBge3J9CmRlbV9ET05PSFVFICU8PiUKICB1bml0ZShjb2wgPSAiVkFSSUFCTEUiLCBSQUNFLCBTRVgsIEFHRV9HUk9VUCwgc2VwID0gIl8iKSAlPiUKICByZW5hbWUoIlZBTFVFIiA9IFBFUkNfU1VCX1BPUCkKCmRlbV9ET05PSFVFCmBgYAoKTGV0J3MgZG8gYSBxdWljayByb3cgbnVtYmVyIGNoZWNrLiBXZSBoYXZlIHNpeCBkaWZmZXJlbnQgZGVtb2dyYXBoaWMgdmFyaWFibGVzLCA1MSBzdGF0ZXMgKERDIGNvdW50cyBhcyBhIHN0YXRlIGluIHRoaXMgY2FzZSksIGFuZCAzNCBkaWZmZXJlbnQgeWVhcnMgZnJvbSAxOTc3IHRvIDIwMTAsIHdlIHNob3VsZCBoYXZlIDEwLDQwNCByb3dzLCB3aGljaCB3ZSBkbyEKCk5vdywgbGV0J3MgZG8gdGhlIHNhbWUgZm9yIHRoZSAiTG90dC1saWtlIiBhbmFseXNpcy4KCgpgYGB7ciwgZWNobz1GQUxTRSwgb3V0LmhlaWdodCA9ICcxMDAlJywgb3V0LndpZHRoID0gJzEwMCUnLCBmaWcuYWxpZ249J2NlbnRlcid9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsJ0Rvbm9odWVfVGFibGUyLnBuZycpKQpgYGAKClNvLCBpbiB0aGlzIGFuYWx5c2lzIHRoZXJlIHdlcmUgMzYgdmFyaWFibGVzIGNvdmVyaW5nIHBlcmNlbnRhZ2VzIG9mIGluZGl2aXVhbHMgZnJvbSAxMCB0byBvdmVyIDY1LCB0aHJlZSAgcmFjZSBncm91cHMgYW5kIGJvdGggbWFsZXMgYW5kIGZlbWFsZXMuIFRoaXMgdGFibGUgaXMgbWlzcHJpbnRlZCBhbmQgZG9lcyBub3QgaW5jbHVkZSB0aGUgd29yZCAiT3RoZXIiIGZvciB0aGUgdGhpcmQgcmFjZSBncm91cCB0aGF0IHdhcyB1c2VkLiAKCkZpcnN0IHdlIHdpbGwgZmlsdGVyIG91dCB0aGUgYWdlIGdyb3VwcyB0aGF0IHdlcmUgbm90IGluY2x1ZGVkLiBUaGVuIHdlIHdpbGwgY29sbGFwc2UgdGhlIGFnZSBncm91cHMgdG8gdGhvc2UgdGhhdCB3ZXJlIHVzZWQgYnkgTG90dCBldCBhbC4gYWdhaW4gdXNpbmcgdGhlIGBmY3RfY29sbHBhc2UoKWAgZnVuY3Rpb24gb2YgdGhlIGBmb3JjYXRzYCBwYWNrYWdlLiAKCkFsc28gd2Ugd2lsbCBhZ2FpbiBjb21iaW5lIHRoZSB2YWx1ZXMgYWNyb3NzIHRoZSB2YXJpYWJsZXMgdG8gY3JlYXRlIGEgbmV3IGRlbW9ncmFwaGljIHZhcmFpYmxlIHdpdGggMzYgbGV2ZWxzLiAKCmBgYHtyfQpMT1RUX0FHRV9HUk9VUFNfTlVMTCA8LSBjKCJVbmRlciA1IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAiNSB0byA5IHllYXJzIikKCmRlbV9MT1RUIDwtIGRlbSAlPiUKICBmaWx0ZXIoIShBR0VfR1JPVVAgJWluJSBMT1RUX0FHRV9HUk9VUFNfTlVMTCkgKSU+JQogIG11dGF0ZShBR0VfR1JPVVAgPSBmY3RfY29sbGFwc2UoQUdFX0dST1VQLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjEwIHRvIDE5IHllYXJzIj1jKCIxMCB0byAxNCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjE1IHRvIDE5IHllYXJzIiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMjAgdG8gMjkgeWVhcnMiPWMoIjIwIHRvIDI0IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiMjUgdG8gMjkgeWVhcnMiKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIzMCB0byAzOSB5ZWFycyI9YygiMzAgdG8gMzQgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICIzNSB0byAzOSB5ZWFycyIpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjQwIHRvIDQ5IHllYXJzIj1jKCI0MCB0byA0NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjQ1IHRvIDQ5IHllYXJzIiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNTAgdG8gNjQgeWVhcnMiPWMoIjUwIHRvIDU0IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNTUgdG8gNTkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI2MCB0byA2NCB5ZWFycyIpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjY1IHllYXJzIGFuZCBvdmVyIj1jKCI2NSB0byA2OSB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjcwIHRvIDc0IHllYXJzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiNzUgdG8gNzkgeWVhcnMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICI4MCB0byA4NCB5ZWFycyIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIjg1IHllYXJzIGFuZCBvdmVyIikpKSAlPiUKICBtdXRhdGUoQUdFX0dST1VQID0gc3RyX3JlcGxhY2VfYWxsKEFHRV9HUk9VUCwiICIsIl8iKSkgJT4lCiAgZ3JvdXBfYnkoWUVBUiwgU1RBVEUsIFJBQ0UsIFNFWCwgQUdFX0dST1VQKSAlPiUKICBzdW1tYXJpc2UoUEVSQ19TVUJfUE9QID0gc3VtKFBFUkNfU1VCX1BPUCksIC5ncm91cHMgPSAiZHJvcCIpICU+JQogIHVuaXRlKGNvbCA9ICJWQVJJQUJMRSIsIFJBQ0UsIFNFWCwgQUdFX0dST1VQLCBzZXAgPSAiXyIpICU+JQogIHJlbmFtZSgiVkFMVUUiPVBFUkNfU1VCX1BPUCkKYGBgCgpXZSBjYW4gaW5kZWVkIGNoZWNrIHRoYXQgd2UgaGF2ZSB0aGUgY29ycmVjdCBudW1iZXIgb2YgbGV2ZWxzIGZvciBgVkFSSUFCTEVgIHVzaW5nIHRoZSBgZGlzdGluY3QoKWAgZnVuY3Rpb24uCgpgYGB7cn0KIGRpc3RpbmN0KGRlbV9MT1RULCBWQVJJQUJMRSkKYGBgCiAgCiMjIENvbWJpbmluZyBwb3B1bGF0aW9uIERhdGEKCldlIGFsc28gaGF2ZSBwb3B1bGF0aW9uIGRhdGEgZm9yIGVhY2ggZGVjYWRlIHRoYXQgY2FtZSBmcm9tIHdyYW5nbGluZyB0aGUgZGVtb2dycGhpYyBkYXRhLgoKV2UgYWdhaW4gd2FudCB0byBjb21iaW5lIHRoaXMgZGF0YSwgc28gbGV0J3MgYWdhaW4gbWFrZSBzdXJlIHRoYXQgYWxsIHRoZSBkaWZmZXJlbnQgdGliYmxlcyBoYXZlIHRoZSBzYW1lIGNvbHVtbiBuYW1lcy4KCmBgYHtyfQpzZXRlcXVhbChjb2xuYW1lcyhwb3BfNzdfNzkpLGNvbG5hbWVzKHBvcF84MF84OSkpCnNldGVxdWFsKGNvbG5hbWVzKHBvcF84MF84OSksY29sbmFtZXMocG9wXzkwXzk5KSkKc2V0ZXF1YWwoY29sbmFtZXMocG9wXzkwXzk5KSxjb2xuYW1lcyhwb3BfMDBfMTApKQoKaGVhZChwb3BfNzdfNzkpCmhlYWQocG9wXzgwXzg5KQpoZWFkKHBvcF85MF85OSkKaGVhZChwb3BfMDBfMTApCmBgYAoKTG9va3MgZ29vZCEKCmBgYHtyfQpwb3B1bGF0aW9uX2RhdGEgPC0gYmluZF9yb3dzKHBvcF83N183OSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwb3BfODBfODksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcG9wXzkwXzk5LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBvcF8wMF8xMCkKCnBvcHVsYXRpb25fZGF0YSA8LSBwb3B1bGF0aW9uX2RhdGEgJT4lCiAgbXV0YXRlKFZBUklBQkxFID0gIlBvcHVsYXRpb24iKSAlPiUKICByZW5hbWUoIlZBTFVFIiA9IFRPVF9QT1ApCmBgYAoKV2UgY291bGQgY2hlY2sgdGhhdCB3ZSBoYXZlIDUxIHZhbHVlcyBmb3IgZWFjaCB5ZWFyIGJ5IHVzaW5nIHRoZSBgY291bnQoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4KCmBgYHtyfQpwb3B1bGF0aW9uX2RhdGEgJT4lCiAgY291bnQoWUVBUikKYGBgCgojIyBQb2xpY2Ugc3RhZmZpbmcKCjxkZXRhaWxzPjxzdW1tYXJ5PiBDbGljayBoZXJlIHRvIHNlZSBkZXRhaWxzIGFib3V0IGhvdyB0aGUgcGxpY2Ugc3RhZmZpbmcgZGF0YSB3YXMgd3JhbmdsZWQuIDwvc3VtbWFyeT4KCk9LLCBub3cgd2Ugd2lsbCB3cmFuZ2xlIHRoZSBwb2xpY2Ugc3RhZmZpbmcgZGF0YS4gV2Ugd2FudCB0byBsaW1pdCB0aGUgZGF0YSB0byBvbmx5IHRoZSB5ZWFycyBvZiBpbnRlcmVzdC4gVGhlbiB3ZSB3aWxsIGFsc28gcmVwbGFjZSBOQSB2YWx1ZXMgd2l0aCB6ZXJvIGZvciB0aGUgYG1hbGVfdG90YWxfY3RgIGFuZCBgZmVtYWxlX3RvdGFsX2N0YCB2YXJpYWJsZXMgdXNpbmcgdGhlIGByZXBsYWNlX25hKClgIGZ1bmN0aW9uIG9mIHRoZSBgdGlkeXJgIHBhY2tnZS4gV2Ugd2lsbCBhbHNvLCB1c2UgdGhlIGBhY3Jvc3MoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZSB0byBzZWxlY3QgYW5kIG11dGF0ZSBib3RoIG9mIHRoZXNlIGNvbHVtbnMgaW4gdGhpcyB3YXkuIFNpbmNlIGJvdGggb2YgdGhlc2UgdmFyaWFibGVzIGhhdmUgYHRvdGFsX2N0YCBpbiB0aGUgbmFtZSBhbmQgbm8gb3RoZXIgdmFyaWFibGVzIGRvLCB3ZSBjYW4gdXNlIHRoZSBgY29udGFpbnMoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZSB0byBzcGVjaWZ5IHRoYXQgd2Ugd2FudCB0byB1c2UgdGhlc2UgY29sdW1ucyBpbnN0ZWFkIG9mIGxpc3RpbmcgYm90aCBvdXQuCgphdm9jYWRvLi4uIHdoeSBub3QgMjAxMC4uLi4KCmBgYHtyfQpnbGltcHNlKHBzX2RhdGEpCgpwc19kYXRhICU8PiUKICBmaWx0ZXIoZGF0YV95ZWFyID49IDE5NzcsIAogICAgICAgICBkYXRhX3llYXIgPD0gMjAxNCkgJT4lCm11dGF0ZShhY3Jvc3MoLmNvbHMgPWNvbnRhaW5zKCJ0b3RhbF9jdCIpLCB+cmVwbGFjZV9uYSguLCAwKSkpCgpnbGltcHNlKHBzX2RhdGEpCmBgYAoKTm93IHdlIGNhbiBjcmVhdGUgYSBuZXcgdmFyaWFibGUgY2FsbGVkIGBvZmZpY2VyX3RvdGFsYCB3aGljaCB3aWxsIGJlIHRoZSBzdW0gb2YgdGhlc2UgdmFyaWFibGVzLiBXZSB3aWxsIHRoZW4ga2VlcCBqdXN0IHRoaXMgdmFyaWFibGUgYXMgd2VsbCBhcyB0aGUgYGRhdGFfeWVhcmAsIGBwdWJfYWdlbmN5X25hbWVgLCBhbmQgYHN0YXRlX2FiYnJgLgoKYGBge3J9Cgpwc19kYXRhICU8PiUKICBtdXRhdGUob2ZmaWNlcl90b3RhbCA9IG1hbGVfdG90YWxfY3QgKyBmZW1hbGVfdG90YWxfY3QpICU+JQogIGRwbHlyOjpzZWxlY3QoZGF0YV95ZWFyLAogICAgICAgICAgICAgICAgcHViX2FnZW5jeV9uYW1lLAogICAgICAgICAgICAgICAgc3RhdGVfYWJiciwKICAgICAgICAgICAgICAgIG9mZmljZXJfdG90YWwpCgpwc19kYXRhCmBgYAoKTm93IHdlIGFsc28gd2FudCB0byBnZXQgY29sbGFwc2UgYnkgYHB1Yl9hZ2VuY3lfbmFtZWAgdG8gZ2V0IGEgdG90YWwgY291bnQgZm9yIGVhY2ggeWVhciBhbmQgZWFjaCBzdGF0ZS4gU28gd2Ugd2lsbCBkbyB0aGlzIGJ5IHVzaW5nIHRoZSBgZ3JvdXBfYnkoKWAgZnVuY3Rpb24gYW5kIGdyb3VwaW5nIGJ5IGBkYXRhX3llYXJgIGFuZCBgc3RhdGVfYWJicmAgYW5kIHVzaW5nIHRoZSBgc3VtbWFyaXNlKClgIGZ1bmN0aW9uIHRvIGNhbGN1bGF0ZSBhIHN1bS4KCmBgYHtyfQpwc19kYXRhICU8PiUKICBncm91cF9ieShkYXRhX3llYXIsIHN0YXRlX2FiYnIpICU+JQogIHN1bW1hcmlzZShvZmZpY2VyX3N0YXRlX3RvdGFsPXN1bShvZmZpY2VyX3RvdGFsKSwgLmdyb3VwcyA9ICJkcm9wIikKCnBzX2RhdGEKYGBgCkFuZCB3ZSB3aWxsIGNoZWNrIHRoYXQgd2UgaGF2ZSBzYW1lIG51bWJlciBvZiB2YWx1ZXMgKHRoZSBudW1iZXIgb2YgeWVhcnMgaW5jbHVkZWQgaW4gdGhlIGRhdGEpIGZvciBlYWNoIHN0YXRlLgoKYGBge3J9Cgpwc19kYXRhICU+JQogIGNvdW50KHN0YXRlX2FiYnIpICAlPiUgaGVhZCgpCgpwc19kYXRhICU+JQogIGNvdW50KHN0YXRlX2FiYnIpICU+JQogIGZpbHRlcihuICE9IDM4KSAlPiUKICBkaW0oKQpgYGAKTG9va3MgbGlrZSBhbGwgdGhlIHN0YXRlcyBoYXZlIDM4IHZhbHVlcy4KCk5vdGljZSBhbHNvIHRoYXQgdGhlcmUgYXJlIHNvbWUgdW51c3VhbCBhYnJyZXZpYXRpb25zIGluIHRoZSBgc3RhdGVfYWJicmAgdmFyaWFibGUuCgpXZSB3aWxsIHJlbW92ZSBkYXRhIGZvciBbVVMgdGVycm9pdG9yaWVzIGFuZCBhc3NvY2lhdGVkIHN0YXRlc10oIGh0dHBzOi8vd3d3LmZzLmZlZC51cy9kYXRhYmFzZS9mZWlzL2Zvcm1hdC5odG1sKXt0YXJnZXQ9Il9ibGFuayJ9ICAKCgpBYmJyZXZpYXRpb24gICB8IFRlcnJpdG9yeSBhbmQgYXNzb2NpYXRlZCBzdGF0ZXMgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIAotLS0tLS0tLS0tIHwtLS0tLS0tLS0tLS0tCioqQVMqKiAgfCBBbWVyaWNhbiBTYW1vYSAKKipHTSoqICB8IEd1YW0KKipDWioqICB8IENhbmFsIFpvbmUKKipGUyoqICB8ID8/RmVkZXJhdGVkIFN0YXRlcyBvZiBNaWNyb25lc2lhICh1c3VhbGx5IEZNKSAgCioqTVAqKiAgfCAgTm9ydGhlcm4gTWFyaWFuYSBJc2xhbmRzCioqT1QqKiAgfCA/P1UuUy4gTWlub3IgT3V0bHlpbmcgSXNsYW5kcyAodXN1YWxseSBVTSkKKipQUioqICB8IFB1ZXJ0byBSaWNvIAoqKlZJKiogIHwgVmlyZ2luIElzbGFuZHMKCgpgYGB7cn0KCnN0YXRlX29mX2ludGVyZXN0X05VTEwgPC0gYygiQVMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIkdNIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICJDWiIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAiRlMiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIk1QIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICJPVCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAiUFIiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIlZJIikKCnBzX2RhdGEgPC0gcHNfZGF0YSAlPiUKICBmaWx0ZXIoIShzdGF0ZV9hYmJyICVpbiUgc3RhdGVfb2ZfaW50ZXJlc3RfTlVMTCkpIApgYGAKICAKV2l0aGluIHRoZSBgZGF0YXNldHNgIHBhY2thZ2UgdGhhdCBpcyBsb2FkZWQgd2l0aCBSLCB0aGVyZSBpcyBhIGRhdGFzZXQgY2FsbGVkIGBzdGF0ZWAgdGhhdCBjb250YWlucyBhbiBvYmplY3QgY2FsbGVkIGBzdGF0ZS5hYmJgIHRoYXQgaGFzIHRoZSBzdGF0ZSBhYmJyZXZpYXRpb25zIGFuZCBgc3RhdGUubmFtZWAgdGhhdCBoYXMgdGhlIHN0YXRlIG5hbWVzLgpXZSB3aWxsIGNvbWJpbmUgdGhlc2Ugbm93IHRvIGFkZCB0aGUgc3RhdGUgbmFtZXMgdG8gb3VyIGRhdGEuCgpgYGB7cn0Kc3RhdGVfYWJiX2RhdGEgPC0gdGliYmxlKCAic3RhdGVfYWJiciIgPSBzdGF0ZS5hYmIsICJTVEFURSIgPXN0YXRlLm5hbWUpCmhlYWQoc3RhdGVfYWJiX2RhdGEpCmBgYAoKT25lIHVudXN1YWwgdGhpbmcgYWJvdXQgdGhpcyBkYXRhIGlzIHRoYXQgTkUgaXMgdXNlZCBmb3IgTmVicmFza2EgdG8gYXZvaWQgY29uZnVzaW9ucyB3aXRoIE5CIGluIENhbmFkYS4gClNvIHdlIHdhbnQgdG8gcmVwYWNlIHRoYXQgdXNpbmcgdGhlIGBzdHJfcmVwbGFjZSgpYCBmdW5jdGlvbiBvZiB0aGUgYHN0cmluZ3JgIHBhY2thZ2UKCmBgYHtyfQpzdGF0ZV9hYmJfZGF0YSAlPD4lCiAgbXV0YXRlKHN0YXRlX2FiYnIgPSBzdHJfcmVwbGFjZShzdHJpbmcgPSBzdGF0ZV9hYmJyLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXR0ZXJuID0gIk5FIiwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICByZXBsYWNlbWVudCA9ICJOQiIpKQpgYGAKCiMjIyMgey5zY3JvbGxhYmxlIH0KYGBge3J9CiMgU2Nyb2xsIHRocm91Z2ggdGhlIG91dHB1dCEKc3RhdGVfYWJiX2RhdGEgJT4lIHByaW50KG4gPSA1MCkKYGBgCiMjIyMKCgpXZSBuZWVkIHRvIGFkZCBEQyB0byB0aGlzLiBXZSB3aWxsIHVzZSB0aGUgYGFkZF9yb3coKWAgZnVuY3Rpb24gb2YgYGRwbHlyYCB0byBkbyB0aGlzLiAgV2UganVzdCBuZWVkIHRvIHNwZWNpZnkgdmFsdWVzIGZvciBib3RoIG9mIHRoZSB2YXJpYWJsZXMuCgpgYGB7cn0Kc3RhdGVfYWJiX2RhdGEgJTw+JQogIGRwbHlyOjphZGRfcm93KHN0YXRlX2FiYnIgPSAiREMiLAogICAgICAgICAgICAgICAgICAgICAgU1RBVEUgPSAiRGlzdHJpY3Qgb2YgQ29sdW1iaWEiKQpgYGAKCk5vdyB3ZSB3aWxsIGFkZCB0aGlzIHRvIG91ciBwb2xpY2Ugc3RhZmZpbmcgZGF0YSBhbmQgdGhlbiByZW1vdmUgdGhlIGBzdGF0ZV9hYmJyYCB2YXJpYWJsZSwgc28gdGhhdCB3ZSBqdXN0IGhhdmUgc3RhdGUgbmFtZXMuIFdlIHdpbGwgYWxzbyAKCmBgYHtyfQpwc19kYXRhICU8PiUKICBsZWZ0X2pvaW4oc3RhdGVfYWJiX2RhdGEsIGJ5ID0gInN0YXRlX2FiYnIiKSAlPiUKICBkcGx5cjo6c2VsZWN0KC1zdGF0ZV9hYmJyKQpwc19kYXRhCmBgYAoKTm93IHdlIHdpbGwgcmVuYW1lIHRoZSB2YXJpYWJsZXMgdG8gbWF0Y2ggdGhvc2Ugb2YgdGhlIG90aGVyIGRhdGFzZXRzLgpgYGB7cn0KcHNfZGF0YSAlPD4lCiAgcmVuYW1lKFlFQVIgPSAiZGF0YV95ZWFyIiwKICAgICAgICAgVkFMVUUgPSAib2ZmaWNlcl9zdGF0ZV90b3RhbCIpICU+JQogIG11dGF0ZShWQVJJQUJMRSA9ICJvZmZpY2VyX3N0YXRlX3RvdGFsIikKcHNfZGF0YQpgYGAKCgpXZSBhbHNvIG5lZWQgdG8gYWRqdXN0IHRoZSB2YWx1ZSB0byBiZSB0aGF0IG9mIGV2ZXJ5IDEwMCwwMDAgcGVvcGxlIGluIHRoZSBzdGF0ZS4gVG8gZG8gc28gd2UgbmVlZCB0aGUgcG9wdWxhdGlvbiBmb3IgZWFjaCBzdGF0ZSwgd2hpY2ggbHVraWx5IHdlIGFscmVhZHkgaGF2ZS4gV2Ugd2lsbCBzbGlnaHRseSBtb2RpZnkgdGhlIHBvcHVsYXRpb24gZGF0YSBhbmQgY3JlYXRlIGEgbmV3IHRpYmJsZSB0aGF0IHdpbGwgbWFrZSBpdCBtb3JlIGNsZWFyIGhvdyB3ZSBhcmUgZGl2aWRpbmcgYnkgaXQuCgpgYGB7cn0KZGVub21pbmF0b3JfdGVtcCA8LSBwb3B1bGF0aW9uX2RhdGEgJT4lCiBzZWxlY3QoLVZBUklBQkxFKSAlPiUKICByZW5hbWUoIlBvcHVsYXRpb25fdGVtcCI9VkFMVUUpCmhlYWQoZGVub21pbmF0b3JfdGVtcCkKCnBzX2RhdGEgJTw+JQogIGxlZnRfam9pbihkZW5vbWluYXRvcl90ZW1wLCBieT1jKCJTVEFURSIsIllFQVIiKSkKaGVhZChwc19kYXRhKQpgYGAKCkF2b2NhZG8gbm90IHN1cmUgd2h5IHRoZSBsYWc/LSBjb3VsZCB1c2UgaW5zaWRlIHBsbSBmdW5jdGlvbi4uLi0gY29uY2VwdHVhbGx5IEkgZ2V0IHdoeSB5b3UgbWlnaHQgd2FudCB0byBrbm93IGhvdyBzdGFmZmluZyBoYXMgY2hhbmdlZCByZWNlbnRseS4uLiBidXQgdGhpcyBkb2VzIG5vdCBzZWVtIHRvIGNhbGN1bGF0ZSB0aGF0Li4uaG1tbW0KCmBgYHtyfQpwc19kYXRhICU8PiUKICBtdXRhdGUoVkFMVUUgPSAoVkFMVUUgKiAxMDAwMDApIC8gUG9wdWxhdGlvbl90ZW1wKSAlPiUKICAjbXV0YXRlKFZBTFVFID0gbGFnKFZBTFVFKSkgJT4lCiAgbXV0YXRlKFZBUklBQkxFID0gInBvbGljZV9wZXJfMTAwa19sYWciKSAlPiUKICBzZWxlY3QoLVBvcHVsYXRpb25fdGVtcCkKCnBzX2RhdGEKYGBgCgo8IS0tIDwvZGV0YWlscz4gLS0+CgoKCiMjIFVuZW1wbG95bWVudAoKVGhlIGZpcnN0IHRoaW5nIHdlIG5lZWQgdG8gZG8gd2l0aCB0aGUgdW5lbXBsb3ltZW50IGRhdGEgaXMgY29tYmluZSB0aGUgZGF0YSBhY3Jvc3MgdGhlIGRpZmZlcmVudCBzdGF0ZXMuCiBXZSBjYW4gZG8gdGhhdCB1c2luZyB0aGUgYGJpbmRfcm93cygpYCBmdW5jdGlvbiBvZiBgZHBseXJgIHdoaWNoIGFwcGVuZHMgdGhlIGRhdGEgdG9nZXRoZXIgYmFzZWQgb24gdGhlIHByZXNlbmNlIG9mIGNvbHVtbnMgd2l0aCB0aGUgc2FtZSBuYW1lIGluIHRoZSBkaWZmZXJlbnQgdGliYmxlcy4gV2Ugd2lsbCB1c2UgdGhlIGBtYXBfZGYoKWAgZnVuY3Rpb24gb2YgdGhlIGBwdXJycmAgcGFja2FnZSB0byBhbGxvdyB1cyB0byBkbyB0aGlzIGFjcm9zcyBlYWNoIHRpYmJsZSBpbiBvdXIgbGlzdC4gV2Ugd2lsbCB0aGVuIHNlbGVjdCBqdXN0IHRoZSBhbm51YWwgZGF0YSBmb3IgZWFjaCBzdGF0ZSBhbmQgeWVhciBhbmQgd2Ugd2lsbCByZW5hbWUgb3VyIHZhcmlhYmxlcyB0byBiZSBjb25zaXN0ZW50IHdpdGggc29tZSBvZiBvdGhlciBkYXRhIHRoYXQgd2UgYXJlIHdvcmtpbmcgd2l0aC4gVGh1cyB3ZSB3b3VsZCBsaWtlIG91ciB2YXJpYWJsZXMgdG8gYmUgYFlFQVJgLCBgVkFMVUVgIGFuZCBgVkFSSUFCTEVgIGluIGFsbCBjYXBzLgogCmBgYHtyfQoKdWVfcmF0ZV9kYXRhIDwtIHVlX3JhdGVfZGF0YSAlPiUKICBtYXBfZGYoYmluZF9yb3dzLCAuaWQgPSAiU1RBVEUiKQoKaGVhZCh1ZV9yYXRlX2RhdGEpCgp1ZV9yYXRlX2RhdGEgPC0gdWVfcmF0ZV9kYXRhICU+JQogIGRwbHlyOjpzZWxlY3QoU1RBVEUsIFllYXIsIEFubnVhbCkgJT4lCiAgcmVuYW1lKCJZRUFSIiA9IFllYXIsCiAgICAgICAgIlZBTFVFIiA9IEFubnVhbCkgJT4lCiAgbXV0YXRlKFZBUklBQkxFID0gIlVuZW1wbG95bWVudF9yYXRlIikKCmhlYWQodWVfcmF0ZV9kYXRhKQpgYGAKCiMjIFBvdmVydHkgcmF0ZQoKCgo8ZGV0YWlscz48c3VtbWFyeT4gQ2xpY2sgaGVyZSB0byBzZWUgZGV0YWlscyBhYm91dCBob3cgdGhlIHBvdmVydHkgZGF0YSB3YXMgd3JhbmdsZWQgPC9zdW1tYXJ5PgoKT0ssIG5vdyBmb3Igd3JhbmdsaW5nIHRoZSBwb3ZlcnR5IGRhdGEuIEZpcnN0IGxldCdzIHRha2UgYSBsb29rIGF0IGl0LiAKYGBge3J9CmhlYWQocG92ZXJ0eV9yYXRlX2RhdGEpCmBgYAoKV2UgY2FuIHNlZSB0aGF0IHRoZSBjb2x1bW4gbmFtZXMgYXJlIGFjdHVhbGx5IHNoaWZ0ZWQgZG93bmJlbG93IHRoZSByb3cgd2l0aCB0aGUgeWVhci4gU28gd2Ugd2lsbCBtYW51YWxseSBtYWtlIHRoZXNlIHZhbHVlcyB0aGUgYWN0dWFsIGNvbHVtbiBuYW1lcy4KCmBgYHtyfQpjb2xuYW1lcyhwb3ZlcnR5X3JhdGVfZGF0YSkgPC0gYygiU1RBVEUiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiVG90YWwiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiTnVtYmVyIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIk51bWJlcl9zZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJQZXJjZW50IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIlBlcmNlbnRfc2UiKQoKcG92ZXJ0eV9yYXRlX2RhdGEyIDwtcG92ZXJ0eV9yYXRlX2RhdGEKCmBgYAoKTGV0J3MgYWxzbyByZW1vdmUgdGhlIHJvd3Mgd2hlcmUgdGhlIGNvbHVtbiBuYW1lcyBhcmUgbGlzdGVkLCBsaWtlIHJvdyBudW1iZXIgMi4KCmBgYHtyfQpwb3ZlcnR5X3JhdGVfZGF0YSAgJTw+JQogIGZpbHRlcihTVEFURSAhPSAiU1RBVEUiKQpoZWFkKHBvdmVydHlfcmF0ZV9kYXRhKQpgYGAKCldlIGNhbiBhbHNvIHNlZSB0aGF0IHRoZXJlIGFyZSBzb21lIGV4dHJhIG5vdGVzIGF0IHRoZSBlbmQgb2Ygb3VyIGRhdGEuIFRoaXMgaXMgd2h5IGl0IGlzIGEgZ29vZCBpZGVhIHRvIGxvb2sgYXQgYm90aCB0aGUgaGVhZCBhbmQgdGFpbCBvZiB5b3VyIGRhdGEuCgpgYGB7cn0KdGFpbChwb3ZlcnR5X3JhdGVfZGF0YSkKYGBgCldlIGNhbiBzZWUgdGhhdCB0aGUgc3RyaW5ncyBmb3IgdGhlIHN0YXRlIGZvciB0aGVzZSByb3dzIGFyZSB2ZXJ5IGxvbmcuIFdlIGNhbiBhbHNvIHNlZSB0aGF0IHRoZXJlIGFyZSByb3dzIHRoYXQganVzdCBoYXZlIHRoZSB5ZWFyLCB3aGVyZSB0aGUgc3RhdGUgaXMgb25seSA0IGNoYXJhY3RlcnMgbG9uZy4gV2Ugd2lsbCBjcmVhdGUgYSBuZXcgdmFyaWFibGUgY2FsbGVkIGBsZW5ndGhfc3RhdGVgIGJhc2VkIG9uIHRoZSBudW1iZXIgb2YgY2hhcmFjdGVycyBpbiB0aGUgYFNUQVRFYCB2YWx1ZXMuIFdlIHdpbGwgdXNlIHRoZSBgc3RyX2xlbmd0aCgpYCBmdW5jdGlvbiBvZiB0aGUgYHN0cmluZ3JgIHBhY2thZ2UuIFdlIG5lZWQgdG8gdXNlIHRoZSBgbWFwX2RibCgpYCBmdW5jdGlvbiB0byBhcHBseSB0aGlzIHRvIGVhY2ggcm93IG9mIHRoZSBgU1RBVEVgIHZhcmlhYmxlLiBUaGUgYG1hcCgpYCBmdW5jdGlvbiBjcmVhdGVzIGEgbGlzdCwgd2hlcmVhcyB0aGUgYG1hcF9kYmwoKWAgZnVuY3Rpb24gY3JlYXRlcyBhIHZlY3RvciBvZiBjbGFzcyBkb3VibGUuIElmIHdlIHdlcmUgdG8gdXNlIGBtYXAoKWAgd2Ugd291bGQgbmVlZCB0byB1c2UgYHVubGlzdCgpYCBhbmQgYHB1bGwoKWAuCgpgYGB7cn0KCnBvdmVydHlfcmF0ZV9kYXRhICU8PiUKIG11dGF0ZShsZW5ndGhfc3RhdGUgPSBtYXBfZGJsKFNUQVRFLCBzdHJfbGVuZ3RoKSkKCiMgQWx0ZXJuYXRpdmVseSB3aXRoIG1hcCgpCiNwb3ZlcnR5X3JhdGVfZGF0YSAlPD4lCiNtdXRhdGUobGVuZ3RoX3N0YXRlID0gdW5saXN0KG1hcChwdWxsKHBvdmVydHlfcmF0ZV9kYXRhLCBTVEFURSksIHN0cl9sZW5ndGgpKSkKCnBvdmVydHlfcmF0ZV9kYXRhCmBgYAoKCkdyZWF0LCBub3cgbGV0J3MgbG9vayBhdCB0aGUgdGFpbCB3aXRoIG91ciBuZXcgdmFyaWFibGUgYGxlbmd0aF9zdGF0ZWAKYGBge3J9CnRhaWwocHVsbChwb3ZlcnR5X3JhdGVfZGF0YSwgbGVuZ3RoX3N0YXRlKSkKCmBgYAoKYGBge3J9CnBvdmVydHlfcmF0ZV9kYXRhICU8PiUgCiAgZmlsdGVyKGxlbmd0aF9zdGF0ZSA8MTAwKQoKdGFpbChwb3ZlcnR5X3JhdGVfZGF0YSkKYGBgCkxvb2tzIGdvb2QhCgpOb3cgbGV0J3Mgc2VsZWN0IGFsbCB0aGUgc3RhdGVzIHRoYXQgYXJlIGFjdHVhbGx5IHllYXIgdmFsdWVzIHRvIGNyZWF0ZSBhIG5ldyB2YXJpYWJsZSBhYm91dCB0aGUgeWVhci4gV2UgY2FuIGRvIHNvIGJ5IHVzaW5nIHRoZSBgc3RyX2RldGVjdCgpYCBmdW5jdGlvbiBvZiB0aGUgYHN0cmluZ3JgIHBhY2thZ2UgdG8gbG9vayBmb3IgZGlnaXRzIG9yIHZhbHVlcyBvZiAwLTkuIFRoaXMgaXMgaW5kaWNhdGVkIGJ5IHVzaW5nIHRoZSBgIls6ZGlnaXQ6XSJgLgoKQXMgeW91IGNhbiBzZWUgaW4gdGhlIFtSU3R1ZGlvIGNoZWF0c2hlZXRdKGh0dHBzOi8vcnN0dWRpby5jb20vcmVzb3VyY2VzL2NoZWF0c2hlZXRzLyl7dGFyZ2V0PSJfYmxhbmsifSAgYWJvdXQgcmVndWxhciBleHByZXNzaW9ucyB0aGlzIG5vdGF0aW9uIGluZGljYXRlcyBhbnkgZGlnaXQgYmV0d2VlbiAwIGFuZCA5LgoKYGBge3J9CmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJyZWdleC5wbmciKSkKYGBgCgojIyMjIHsuc2Nyb2xsYWJsZSB9CgpgYGB7cn0KIyBTY3JvbGwgdGhyb3VnaCB0aGUgb3V0cHV0IQpwb3ZlcnR5X3JhdGVfZGF0YSAlPiUgCiAgZmlsdGVyKHN0cl9kZXRlY3QoU1RBVEUsICJbOmRpZ2l0Ol0iKSkgJT4lCiAgcHJpbnQobiA9IDUxKQpgYGAKCiMjIyMKClNvbWUgb2YgdGhlIHllYXJzICgyMDEzIGFuZCAyMDE3KSBhcmUgbGlzdGVkIHR3aWNlIHdpdGggYSBudW1iZXIgaW4gcGFyYW50aGVzZXMsIG90aGVycyBhcmUganVzdCBsaXN0ZWQgb25jZSB3aXRoIGEgbnVtYmVyIGluIHBhcmFudGhlc2VzLiBMb29raW5nIGF0IHRoZSB0ZWNobmljYWwgZG9jdW1lbnRhdGlvbiwgdGhpcyBzZWVtcyB0byBkbyB3aXRoIHVwZGF0ZXMgdG8gdGhlIGRlZml0aW9uIG9mIHBvdmVydHkgYW5kIHRvIHRoZSBtZXRob2RzIHVzZWQgdG8gZXN0aW1hdGUgcG92ZXJ0eSBsZXZlbHMuIFNlZSBbaGVyZV0oaHR0cHM6Ly93d3cuY2Vuc3VzLmdvdi90b3BpY3MvaW5jb21lLXBvdmVydHkvcG92ZXJ0eS9ndWlkYW5jZS9wb3ZlcnR5LWZvb3Rub3Rlcy9jcHMtaGlzdG9yaWMtZm9vdG5vdGVzLmh0bWwpe3RhcmdldD0iX2JsYW5rIn0gYW5kIFtoZXJlXShodHRwczovL3d3dzIuY2Vuc3VzLmdvdi9wcm9ncmFtcy1zdXJ2ZXlzL2Nwcy90ZWNoZG9jcy9jcHNtYXIxOS5wZGYpe3RhcmdldD0iX2JsYW5rIn0gZm9yIG1vcmUgaW5mb3JtYXRpb24uIFdlIHdpbGwgc2ltcGx5IHNlbGVjdCBvbmUgb2YgdGhlIHNldHMgb2YgZGF0YSBmb3IgMjAxMyBhbmQgMjAxNy4KCmBgYHtyfQpwb3ZlcnR5X3JhdGVfZGF0YSAlPiUgCiAgZmlsdGVyKHN0cl9kZXRlY3QoU1RBVEUsICIyMDEzIikpICU+JQogIGZpbHRlcihzdHJfZGV0ZWN0KFNUQVRFLCAiMjAxNyIpKQpgYGAKCkZpcnN0IGxldCdzIGFkZCB0aGUgeWVhciB2YWx1ZSB0byBvdXIgZGF0YS4gCgoKVGhlcmUgc2hvdWxkIGJlIGNvbnNpc3RlbnRseSBkYXRhIGZvciA1MSBzdGF0ZXMgKGluY2x1ZGluZyBEQykuIFdlIGNhbiBzZWUgdGhhdCBzb21ldGltZXMgREMgaXMgc3BlbGxlZCBvdXQgYW5kIHNvbWV0aW1lcyBpdCBpcyBub3QuCgojIyMjIHsuc2Nyb2xsYWJsZSB9CmBgYHtyfQojIyMgU2Nyb2xsIHRocm91Z2ggdGhlIG91dHB1dCEKcG92ZXJ0eV9yYXRlX2RhdGEgJT4lIAogIGZpbHRlcihzdHJfZGV0ZWN0KFNUQVRFLCAiWzphbHBoYTpdIikpICU+JQogIGRpc3RpbmN0KFNUQVRFKSAlPiUgcHJpbnQobiA9IDEwMCkKCmBgYAojIyMjCgoKTm93IHdlIHdpbGwgcmVwbGFjZSBgIkQuQy4iYCB3aXRoIGAiRGlzdHJpY3Qgb2YgQ29sdW1iaWEiYCB1c2luZyBgc3RyX3JlcGxhY2UoKWAuIFdlIGNhbiB1c2UgdGhlIGB0YWxseSgpYCBmdW5jdGlvbiBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlIHRvIGNoZWNrIHRoYXQgd2UgaGF2ZSBmZXdlciBub3cuCgpgYGB7cn0KcG92ZXJ0eV9yYXRlX2RhdGEgJTw+JSAKbXV0YXRlKFNUQVRFID0gc3RyX3JlcGxhY2UoU1RBVEUsIHBhdHRlcm4gPSAiRC5DLiIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICByZXBsYWNlbWVudCA9ICJEaXN0cmljdCBvZiBDb2x1bWJpYSIgKSkKCnBvdmVydHlfcmF0ZV9kYXRhICU+JSAKICBmaWx0ZXIoc3RyX2RldGVjdChTVEFURSwgIls6YWxwaGE6XSIpKSAlPiUKICBkaXN0aW5jdChTVEFURSkgJT4lIHRhbGx5KCkKYGBgCkdyZWF0ISBOb3cgYXJlIGVhY2ggb2YgdGhlIHN0YXRlcyBvY2N1cnJpbmcgYXMgb2Z0ZW4gYXMgdGhlIHVuaXF1ZSB5ZWFyIHZhbHVlcz8gV2UgY2FuIGZpcnN0IGNoZWNrIGhvdyBtYW55IHllYXIgdmFsdWVzIHRoZXJlIGFyZS4gVGhlbiBjYW4gdXNlIHRoZSBgY291bnQoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZSB0byBjaGVjayBob3cgb2Z0ZW4gdGhlIHN0YXRlcyBhcmUgcmVwZWF0ZWQuCgpgYGB7cn0KCnBvdmVydHlfcmF0ZV9kYXRhICU+JSAKICBmaWx0ZXIoc3RyX2RldGVjdChTVEFURSwgIls6ZGlnaXQ6XSIpKSAlPiUKICB0YWxseSgpCmBgYAoKVGhlcmUgYXJlIDQxIGRpZmZlcmVudCBzZXRzIG9mIGRhdGEgYWNjb3JkaW5nIHRvIHllYXIgdmFsdWVzLgoKIyMjIyB7LnNjcm9sbGFibGUgfQpgYGB7cn0KIyMjIFNjcm9sbCB0aHJvdWdoIHRoZSBvdXRwdXQhCnBvdmVydHlfcmF0ZV9kYXRhICU+JSAKICBmaWx0ZXIoc3RyX2RldGVjdChTVEFURSwgIls6YWxwaGE6XSIpKSAlPiUKICBjb3VudChTVEFURSkgJT4lIAogIHByaW50KG4gPSA1MSkKYGBgCiMjIyMKCkluZGVlZCwgbG9va3MgbGlrZSBlYWNoIG9mIHRoZSBzdGF0ZXMgYXJlIHJlcGVhdGVkIHRoZSBzYW1lIG51bWJlciBvZiB0aW1lcyEKCk5vdyBsZXQncyBjcmVhdGUgYSBuZXcgdmFyaWFibGUgYFlFQVJgIHRoYXQgcmVwZWF0cyB0aGUgeWVhciB2YWx1ZXMgZm9yIGFsbCBvZiB0aGUgZGlmZmVyZW50IHN0YXRlcyBhbmQgZm9yIHRoZSByb3cgdGhhdCBoYXMganVzdCB0aGUgeWVhciB2YWx1ZSBmb3IgYSB0b3RhbCBvZiA1Mi4KCmBgYHtyfQoKeWVhcl92YWx1ZXMgPC0gcG92ZXJ0eV9yYXRlX2RhdGEgJT4lIAogIGZpbHRlcihzdHJfZGV0ZWN0KFNUQVRFLCAiWzpkaWdpdDpdIikpICU+JQogIGRpc3RpbmN0KFNUQVRFKQoKICB5ZWFyX3ZhbHVlczwtcmVwKHB1bGwoeWVhcl92YWx1ZXMsIFNUQVRFKSwgZWFjaCA9IDUyKQpzZXRlcXVhbChsZW5ndGgoeWVhcl92YWx1ZXMpLCBsZW5ndGgocG92ZXJ0eV9yYXRlX2RhdGEkU1RBVEUpKQpgYGAKCk5vdyB3ZSB3aWxsIGFkZCB0aGlzIHRvIG91ciBgcG92ZXJ0eV9yYXRlX2RhdGFgLiBXZSB3aWxsIGFsc28gcmVtb3ZlIHRoZSBgbGVuZ3RoX3N0YXRlYCB2YXJpYWJsZSB1c2luZyB0aGUgYHNlbGVjdCgpYCBmdW5jdGlvbiBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlIGFuZCBhIG1pbnVzIHNpZ24gYmVmb3JlIHRoZSB2YXJpYWJsZSBuYW1lLgoKYGBge3J9CnBvdmVydHlfcmF0ZV9kYXRhICU8PiUKICBtdXRhdGUoeWVhcl92YWx1ZSA9IHllYXJfdmFsdWVzKSAlPiUKICBzZWxlY3QoLWxlbmd0aF9zdGF0ZSkKYGBgCgojIyMjIHsuc2Nyb2xsYWJsZSB9CmBgYHtyfQojU2Nyb2xsIHRocm91Z2ggdGhlIG91dHB1dCEKcG92ZXJ0eV9yYXRlX2RhdGEgJT4lIHByaW50KG4gPSAxMDApCmBgYAojIyMjCgpMb29rcyBnb29kISBOb3cgd2Ugd2lsbCByZW1vdmUgdGhlIHJvd3MgdGhhdCBoYXZlIGp1c3QgdGhlIHllYXIgdmFsdWVzIGJ5IG9ubHkgcHJlc2VydmluZyB0aG9zZSB3aXRoIGFscGhhIGNoYXJhY3RlcnMuCgpgYGB7cn0KcG92ZXJ0eV9yYXRlX2RhdGEgJTw+JQogICAgZmlsdGVyKHN0cl9kZXRlY3QoU1RBVEUsICJbOmFscGhhOl0iKSkKCmBgYAoKTm93IGxldCdzIHJlbW92ZSB0aGUgb2xkZXIgZGF0YSBmb3IgMjAxMyBhbmQgMjAxNyB3aGljaCBpcyB0aGUgZGF0YSB0aGF0IGFwcGVhcnMgbG93ZXIgaW4gdGhlIHRpYmJsZS4KCmBgYHtyfQpwb3ZlcnR5X3JhdGVfZGF0YSAlPD4lCmZpbHRlcih5ZWFyX3ZhbHVlICE9ICIyMDE3IikgJT4lCmZpbHRlcih5ZWFyX3ZhbHVlICE9ICIyMDEzICgxOCkiKQpgYGAKCgpXZSBhbHNvIHdhbnQgdG8ganVzdCBrZWVwIHRoZSBmaXJzdCA0IGRpZ2l0cyBvZiB0aGUgeWVhcl92YWx1ZSBhbmQgY3JlYXRlIGEgYFlFQVJgIHZhcmlhYmxlLiBXZSBuZWVkIHRvIHB1bGwgdGhlIGB5ZWFyX3ZhbHVlYCBkYXRhIGJlY2F1c2UgYHN0cl9zdWIoKWAgZXhwZWN0cyBhIGNoYXJhY3RlciB2ZWN0b3Igbm90IGEgdGliYmxlLgoKYGBge3J9CnBvdmVydHlfcmF0ZV9kYXRhICU8PiUKICBtdXRhdGUoWUVBUiA9IHN0cl9zdWIocHVsbCguLCB5ZWFyX3ZhbHVlKSwgc3RhcnQgPSAxLCBlbmQ9NCkpCmBgYAoKIyMjIyB7LnNjcm9sbGFibGUgfQpgYGB7cn0KcG92ZXJ0eV9yYXRlX2RhdGEgCmBgYAojIyMjCgpMb29rcyBnb29kISBOb3cgd2Ugd2lsbCBqdXN0IHJlbW92ZSB0aGUgZXh0cmEgdmFyaWFibGVzIGFuZCByZW5hbWUgdGhlIHZhcmlhYmxlcyB3ZSB3YW50IHRvIGtlZXAgdG8gYmUgc2ltaWxhciB0byBvdXIgb3RoZXIgZGF0YS4KCmBgYHtyfQpwb3ZlcnR5X3JhdGVfZGF0YSAlPD4lCiAgZHBseXI6OnNlbGVjdCgtIE51bWJlciwKICAgICAgICAgICAgICAgIC0gTnVtYmVyX3NlLAogICAgICAgICAgICAgICAgLSBQZXJjZW50X3NlLAogICAgICAgICAgICAgICAgLSBUb3RhbCwKICAgICAgICAgICAgICAgIC0geWVhcl92YWx1ZSkgJT4lCiAgcmVuYW1lKCJWQUxVRSIgPSBQZXJjZW50KSAlPiUKICBtdXRhdGUoVkFSSUFCTEUgPSAiUG92ZXJ0eV9yYXRlIiwKICAgICAgICAgWUVBUiA9IGFzLm51bWVyaWMoWUVBUiksCiAgICAgICAgIFZBTFVFID0gYXMubnVtZXJpYyhWQUxVRSkpCmhlYWQocG92ZXJ0eV9yYXRlX2RhdGEpCmBgYAoKTG9va3MgZ3JlYXQhIEFWT0NBRE8gdGhpcyBkYXRhIGlzIHBlciAxMDAwaz8gSSB0aGluayBJIG5lZWQgdG8gcmVzdHJpY3QgdG8gMjAxNCB0byBtYXRjaCB0aGUgb3RoZXIgZGF0YSBhbmQgdGhhdHMgd2h5IEkgZ2V0IGFuIGVycm9yIHdoZW4gbWFraW5nIHRoZSBEb25vaHVlX2RmIAoKCkZyb20gTWljaGFlbDoKYGBge3IsIGV2YWwgPSBGQUxTRX0KCnBvdmVydHlfcmF0ZV9kYXRhIDwtcG92ZXJ0eV9yYXRlX2RhdGEyCm5vdGVzIDwtIDQKCnBvdmVydHlfcmF0ZV9kYXRhMiA8LSBwb3ZlcnR5X3JhdGVfZGF0YVstKChkaW0ocG92ZXJ0eV9yYXRlX2RhdGEpWzFdLW5vdGVzKzEpOmRpbShwb3ZlcnR5X3JhdGVfZGF0YSlbMV0pLF0KCnN0YXRlc19lcSA8LSA1MQoKZXh0cmFfY29sIDwtIDIKCnJlcF9yb3dzIDwtIHN0YXRlc19lcSArIGV4dHJhX2NvbAoKZ3JvdXBzIDwtIChkaW0ocG92ZXJ0eV9yYXRlX2RhdGEpWzFdKS8ocmVwX3Jvd3MpCgpwYXN0ZShncm91cHMgLSAoMjAxOC0xOTgwICsgMSksICJleHRyYSBncm91cHMiKQoKcG92ZXJ0eV9yYXRlX2RhdGEkeWVhcl9ncm91cCA8LSByZXAoMTpncm91cHMsIGVhY2g9cmVwX3Jvd3MpCgpwb3ZlcnR5X3JhdGVfZGF0YSA8LSBwb3ZlcnR5X3JhdGVfZGF0YSAlPiUKICBncm91cF9ieSh5ZWFyX2dyb3VwKSAlPiUKICBncm91cF9zcGxpdCgpCgpoZWFkKHBvdmVydHlfcmF0ZV9kYXRhW1sxXV0pCgpwb3ZlcnR5X3JhdGVfZGF0YSA8LSBwb3ZlcnR5X3JhdGVfZGF0YSAlPiUKICBtYXAofm11dGF0ZSguLAogICAgICAgICAgICAgIHJvd19pZCA9IHJvd19udW1iZXIoKSkpICU+JQogIG1hcCh+ZmlsdGVyKC4scm93X2lkICE9IDIpKSAlPiUKICBtYXAofmRwbHlyOjpzZWxlY3QoLiwtcm93X2lkKSkKCnBvdmVydHlfcmF0ZV9kYXRhX25hbWVzIDwtIHBvdmVydHlfcmF0ZV9kYXRhICU+JQogIHNhcHBseSguLCAiWyIsMSwxLCBkcm9wPVRSVUUpICU+JQogIHN0cl9yZXBsYWNlX2FsbCguLCJbOnNwYWNlOl0iLCJfIikKCm5hbWVzKHBvdmVydHlfcmF0ZV9kYXRhKSA8LSBwb3ZlcnR5X3JhdGVfZGF0YV9uYW1lcwoKIyBSZWNhbGwgMiBleHRyYSBncm91cHMuIAojIGZvb3Rub3RlcyBhdmFpbGFibGUgYXQgaHR0cHM6Ly93d3cuY2Vuc3VzLmdvdi90b3BpY3MvaW5jb21lLXBvdmVydHkvcG92ZXJ0eS9ndWlkYW5jZS9wb3ZlcnR5LWZvb3Rub3Rlcy9jcHMtaGlzdG9yaWMtZm9vdG5vdGVzLmh0bWwKCnBvdmVydHlfcmF0ZV9kYXRhJGAyMDE3XygyMSlgIDwtIE5VTEwKCnBvdmVydHlfcmF0ZV9kYXRhJGAyMDEzXygxOSlgIDwtIE5VTEwKCnBvdmVydHlfcmF0ZV9kYXRhX25hbWVzIDwtIHBvdmVydHlfcmF0ZV9kYXRhICU+JQogIHNhcHBseSguLCAiWyIsMSwxLCBkcm9wPVRSVUUpICU+JQogIHN0cl9zdWIoLiwgc3RhcnQgPSAxLCBlbmQ9NCkKCm5hbWVzKHBvdmVydHlfcmF0ZV9kYXRhKSA8LSBwb3ZlcnR5X3JhdGVfZGF0YV9uYW1lcwoKcG92ZXJ0eV9yYXRlX2RhdGEgPC0gcG92ZXJ0eV9yYXRlX2RhdGEgJT4lCiAgbWFwX2RmKGJpbmRfcm93cywgLmlkID0gIllFQVIiKSAlPiUKICBkcGx5cjo6c2VsZWN0KC15ZWFyX2dyb3VwKQoKcG92ZXJ0eV9yYXRlX2RhdGEgPC0gcG92ZXJ0eV9yYXRlX2RhdGEgJT4lCiAgICBtdXRhdGUobl9uYSA9IHJvd1N1bXMoaXMubmEoLikpKSAKCiMgVGhpcyBzaG93cyB0aGF0IHRoZXJlIGlzIHN5c3RlbWF0aWMgbWlzc2luZyB2YWx1ZXMgc3RlbW1pbmdseSAqc29sZWx5KiBmcm9tIHRoZSByb3dzIHdpdGhvdXQgcG92ZXJ0eSBkYXRhIGFuZCBvbmx5IGEgbGFiZWwgZGVzaWduYXRpbmcgdGhlIHllYXIKcG92ZXJ0eV9yYXRlX2RhdGEgJT4lIAogIGdyb3VwX2J5KG5fbmEpICU+JQogIHRhbGx5KCkKCnNhcHBseShwb3ZlcnR5X3JhdGVfZGF0YSwgY2xhc3MpCgoKCmNvbG5hbWVzKHBvdmVydHlfcmF0ZV9kYXRhKQpgYGAKCjwhLS0gPC9kZXRhaWxzPiAtLT4KCgoKIyMgVmlvbGVudCBjcmltZQoKCgo8ZGV0YWlscz48c3VtbWFyeT4gQ2xpY2sgaGVyZSB0byBzZWUgZGV0YWlscyBhYm91dCBob3cgdGhlIHZpb2xlbnQgY3JpbWUgZGF0YSB3YXMgd3JhbmdsZWQgPC9zdW1tYXJ5PgoKVGhlIGBjcmltZV9kYXRhYCB3YXMgaW1wb3J0YXRlZCB1c2luZyBgcmVhZF9saW5lcygpYCBhbmQgd2UgaGF2ZSBzb21lIGxpbmVzIHRoYXQgd2UgZG9uJ3QgbmVjZXNzYXJpbHkgbmVlZC4gQSBsYXJnZSBhbW91bnQgb2YgdGhlIG9yaWdpbmFsIGRhdGEgaXMgbm90ZXMgYXQgdGhlIGVuZCBvZiB0aGUgdGFibGUuIFdlIHdhbnQgdG8gcmVtb3ZlIHRoZXNlIGxpbmVzLiBXZSBjYW4gZGV0ZXJtaW5lIHdoZXJlIHRoZXkgc3RhcnQgYnkgc2VhcmNoaW5nIGZvciB0aGUgcm93IHRoYXQgY29udGFpbnMgdGhlIGZpcnN0IHN0YXRlbWVudCBvZiB0aGVzZSBub3RlcyB1c2luZyB0aGUgYHN0cl93aGljaCgpYCBmdW5jdGlvbiBvZiB0aGUgYHN0cmluZ3JgIHBhY2thZ2UuIFdlIHdpbGwgc3VidHJhY3Qgb25lIGZyb20gdGhpcyBhcyB0aGVyZSBpcyBhIGJsYW5rIGxpbmUgaW4gYmV0d2Vlbi4KCmBgYHtyfQp0YWlsKGNyaW1lX2RhdGEpCmNyaW1lX2RhdGEgPC0gY3JpbWVfZGF0YVstKChzdHJfd2hpY2goY3JpbWVfZGF0YSwgIlRoZSBmaWd1cmVzIHNob3duIGluIHRoaXMgY29sdW1uIGZvciB0aGUgb2ZmZW5zZSBvZiByYXBlIHdlcmUgZXN0aW1hdGVkIHVzaW5nIHRoZSBsZWdhY3kgVUNSIGRlZmluaXRpb24gb2YgcmFwZSIpLTEpOiBsZW5ndGgoY3JpbWVfZGF0YSkpXQojY3JpbWVfZGF0YSA8LSBjcmltZV9kYXRhWy0oMjE0MzpsZW5ndGgoY3JpbWVfZGF0YSkpXQp0YWlsKGNyaW1lX2RhdGEpCmBgYAoKVGhlcmUgYXJlIGxpbmVzIGZvciBlYWNoIHllYXIgZnJvbSAxOTc3IHRvIDIwMTQgYXMgd2VsbCBhcyBmb3VyIGxpbmVzIGFib3V0IGVhY2ggc3RhdGUgYW5kIHRoZSBoZWFkZXIgaW5mb3JtYXRpb24gZm9yIGVhY2ggc3RhdGUuIApIZXJlIHlvdSBjYW4gc2VlIHdoYXQgdGhlIG9yZ2luYWwgZGF0YSBsb29rcyBsaWtlOgpgYGB7cn0Ka25pdHI6OmluY2x1ZGVfZ3JhcGhpY3MoaGVyZSgiaW1nIiwgImNyaW1lX2RhdGEucG5nIikpCmBgYAoKV2Ugd2FudCB0byBkZWxldGUgdGhlIGhlYWRlciBpbmZvcm1hdGlvbiBhbmQgb25seSByZXRhaW4gdGhlIGxpbmVzIG51bWVyaWMgdmFsdWVzIG9yIHN0YXRlIG5hbWVzLiAgVGh1cyBzaW5jZSB0aGVyZSBhcmUgMzggeWVhcnMgd29ydGggb2YgZGF0YSBmb3IgZWFjaCBzdGF0ZSBhbmQgNCBsaW5lcyBmb3IgZWFjaCBoZWFkZXIsIHRoZW4gZWFjaCBzdGF0ZSBoYXMgNDIgbGluZXMuIFdlIHdhbnQgdG8gZGVsZXRlIHRoZSBsaW5lcyBiZXR3ZWVuIGFuZCBpbmNsdWRpbmcgbGluZSAyIHRvIDQgZm9yIGVhY2ggc3RhdGUuIFdlIHdpbGwgc2F2ZSB0aGUgaGVhZGVyIGluZm9ybWF0aW9uIG9uY2UgdG8gdXNlIGxhdGVyLgpgYGB7cn0KaGVhZChjcmltZV9kYXRhKQp4IDwtIDIwMTQtMTk3NysxCnJlcF9jeWNsZSA8LSA0ICsgeApyZXBfY3ljbGVfY3V0IDwtIDIgKyB4CmNvbG5hbWVzX2NyaW1lPC0oY3JpbWVfZGF0YVs0XSkKYGBgCgpTbyBzdGFydGluZyBhdCBsaW5lIDIgYW5kIGFuZCAzIGFuZCA0IHdlIGNyZWF0ZSBhIHNlcXVlbmNlIG9mIG51bWJlcnMgdGhhdCBpbmNyZWFzZSBieSB0aGUgbnVtYmVyIG9mIHJvd3Mgb2YgdGhlIGxlbmd0aCBvZiB0aGUgaW5kaXZpZHVhbCBzdGF0ZSBkYXRhLiBXZSBjYW4gZG8gc28gdXNpbmcgdGhlIGJhc2UgYHNlcSgpYCBmdW5jdGlvbi4gV2UgY2FuIHRha2UgYSBsb29rIGF0IHRoZXNlIGluIG9yZGVyIHVzaW5nIHRoZSBiYXNlIGBzb3J0KClgIGZ1bmN0aW9uLgoKYGBge3J9CmRlbGV0ZV9yb3dzIDwtIGMoc2VxKGZyb20gPSAyLAogICAgICAgICAgICAgICAgICAgICAgIHRvID0gbGVuZ3RoKGNyaW1lX2RhdGEpLAogICAgICAgICAgICAgICAgICAgICAgIGJ5ID0gcmVwX2N5Y2xlKSwKICAgICAgICAgICAgICAgICBzZXEoZnJvbSA9IDMsCiAgICAgICAgICAgICAgICAgICAgICAgdG8gPSBsZW5ndGgoY3JpbWVfZGF0YSksCiAgICAgICAgICAgICAgICAgICAgICAgYnkgPSByZXBfY3ljbGUpLCAKICAgICAgICAgICAgICAgICBzZXEoZnJvbSA9IDQsCiAgICAgICAgICAgICAgICAgICAgICAgdG8gPSBsZW5ndGgoY3JpbWVfZGF0YSksCiAgICAgICAgICAgICAgICAgICAgICAgYnkgPSByZXBfY3ljbGUpKQpzb3J0KGRlbGV0ZV9yb3dzKQoKYGBgClRodXMgd2Ugd2lsbCBkZWxldGUgbGluZXMgMiwgMywgYW5kIDQgYW5kIHRoZW4gc2tpcCA0MCBsaW5lcyAodG8gYWNjb3VudCBmb3IgdGhlIHN0YXRlIGluZm9ybWF0aW9uIGZvciB0aGUgZmlyc3Qgc3RhdGUsIHRoZSBsaW5lcyBvZiBpbmZvcm1hdGlvbiBmb3IgdGhlIDM4IHllYXJzLCBhbmQgdGhlbiB0aGUgc3RhdGUgaW5mb3JtYXRpb24gZm9yIHRoZSBuZXh0IHN0YXRlKSBhbmQgdGhlbiBkZWxldGUgdGhlIG5leHQgMyBjb25zZWN1dGl2ZSBsaW5lcyBhbmQgc28gb24uIFdlIGNhbiBpbmRlZWQgc2VlIHRoYXQgbGluZSA0NC00NiBhcmUgd2hhdCB3ZSB3aXNoIHRvIHJlbW92ZS4KCmBgYHtyfQpjcmltZV9kYXRhWzQ0OjQ2XQpgYGAKCmBgYHtyfQpjcmltZV9kYXRhIDwtIGNyaW1lX2RhdGFbLWRlbGV0ZV9yb3dzXQpgYGAKCgpOaWNlIQoKTm93IHdlIGNhbiBzZWxlY3QgYWxsIHRoZSBsaW5lcyB0aGF0IGhhdmUgc3RhdGUgaW5mb3JtYXRpb24uIFdlIGNhbiByZXBlYXQgZWFjaCBvZiB0aGVzZSBmb3IgdGhlIDM4IHllYXJzIGZvciBlYWNoIHN0YXRlIGFzIHdlbGwgYXMgdGhpcyBsaW5lIHRoYXQgY29udGFpbnMgdGhlIHN0YXRlIGluZm9ybWF0aW9uIGJ5IHVzaW5nIHRoZSBiYXNlIGByZXAoKWAgZnVuY3Rpb24gd2l0aCB0aGUgYGVhY2ggPWAgYXJndW1lbnQuIEZpbmFsbHkgd2Ugd2lsbCByZW1vdmUgdGhlIGAiRXN0aW1hdGVkIGNyaW1lIGluICJgIHBvcnRpb24gb2YgdGhlIHN0cmluZyB1c2luZyB0aGUgYHN0cl9yZW1vdmUoKWAgZnVuY3Rpb24gb2YgdGhlIGBzdHJpbmdyYCBwYWNrYWdlLiAgV2Ugd2lsbCBsYXRlciBjb21iaW5lIHRoaXMgd2l0aCB0aGUgY3JpbWUgZGF0YS4KCmBgYHtyfQpzdGF0ZV9sYWJlbF9vcmRlciA8LWNyaW1lX2RhdGFbc3RyX3doaWNoKGNyaW1lX2RhdGEsICJFc3RpbWF0ZWQgY3JpbWUiKV0Kc3RhdGVfbGFiZWxfb3JkZXIKCnN0YXRlX2xhYmVsX29yZGVyIDwtIHJlcChzdGF0ZV9sYWJlbF9vcmRlciwgZWFjaCA9IDM4KQoKY3JpbWVfc3RhdGVzIDwtc3RyX3JlbW92ZShzdGF0ZV9sYWJlbF9vcmRlciwgcGF0dGVybiA9ICJFc3RpbWF0ZWQgY3JpbWUgaW4gIikKaGVhZChjcmltZV9zdGF0ZXMpCmBgYAoKTmljZSEgTm93IGZvciB0aGUgcmVzdCBvZiB0aGUgZGF0YS4gV2Ugbm93IG5lZWQgdG8gcmVtb3ZlIHRoZSBsaW5lcyB3aXRoIHRoZSBzdGF0ZSBpbmZvcm1hdGlvbi4KCmBgYHtyfQpjcmltZV9kYXRhIDwtY3JpbWVfZGF0YVstc3RyX3doaWNoKGNyaW1lX2RhdGEsICJFc3RpbWF0ZWQgY3JpbWUiKV0KaGVhZChjcmltZV9kYXRhKQp0YWlsKGNyaW1lX2RhdGEpCmBgYAoKSXQgYXBwZWFycyB0aGF0IHRoZSBkYXRhIGlzIGNvbW1hIHNlcGFydGVkIHdpdGggOCBjb2x1bW5zLiBPbmUgb2YgdGhlIG1pZGRsZSBjb2x1bW5zIG9mdGVuIGhhcyBubyB2YWx1ZXMsIHdlIG5lZWQgdG8gZmlsbCB0aGVzZSBpbiB3aXRoIE5Bcy4gV2UgY2FuIHVzZSB0aGUgYHJlYWRfY3N2KClgIGZ1Y250aW9uIGZyb20gdGhlIGByZWFkcmAgcGFja2FnZSB0byBkbyB0aGlzLiBJdCB0dXJucyBvdXQgeW91IGRvbid0IGhhdmUgdG8gaGF2ZSBhIGZpbGUsIGJ1dCB5b3UgY2FuIGFsc28gdXNlIGEgc3RyaW5nIG91ciBhIHZlY3Rvci4KCmBgYHtyfQpjcmltZV9kYXRhX3NlcCA8LXJlYWRfY3N2KGNyaW1lX2RhdGEsIGNvbF9uYW1lcyA9IEZBTFNFKQpoZWFkKGNyaW1lX2RhdGEpCmBgYApOaWNlISBOb3cgd2UganVzdCBuZWVkIG91ciBjb2xuYW1lcy4gUmVjYWxsIHRoYXQgd2Ugc2F2ZWQgdGhpcyBpbmZvcm1hdGlvbi4gCgpgYGB7cn0KY29sbmFtZXNfY3JpbWUKCmNvbG5hbWVzKGNyaW1lX2RhdGFfc2VwKSA8LWMoIlllYXIiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICJQb3B1bGF0aW9uIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiVmlvbGVudF9jcmltZV90b3RhbCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIk11cmRlcl9hbmRfbm9ubmVnbGlnZW50X01hbnNsYXVnaHRlciIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIkxlZ2FjeV9yYXBlIiAsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIlJldmlzZWRfcmFwZSIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICJSb2JiZXJ5IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAiQWdncmF2YXRlZF9hc3NhdWx0IikKaGVhZChjcmltZV9kYXRhX3NlcCkKYGBgCgpXZSBhbHNvIHdhbnQgdG8gY29tYmluZSB0aGlzIHdpdGggdGhlIHN0YXRlIGluZm9ybWF0aW9uIHdlIGNvbGxlY3RlZCBlYXJsaWVyLgpXZSB3aWxsIHVzZSB0aGUgYGJpbmRfY29scygpYCBmdW5jdGlvbiBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlIHRvIGRvIHRoaXMuIFRoaXMgcmVxdWlyZXMgdGhhdCB0aGUgZGF0YSBoYXZlIHRoZSBzYW1lIG51bWJlciBvZiByb3dzLgoKYGBge3J9CmNyaW1lX2RhdGFfc2VwIDwtYmluZF9jb2xzKFNUQVRFID1jcmltZV9zdGF0ZXMsIAogICAgICAgICAgY3JpbWVfZGF0YV9zZXApCgpgYGAKCk5vdyB3ZSB3aWxsIHJlbmFtZSB0aGUgYFZpb2xfY3JpbWVfY291bnRgIHZhcmlhYmxlIHRvIGJlIGBWYXJpYWJsZWAgYW5kIHdlIHdpbGwgcmVtb3ZlIGFsbCBvZiB0aGUgb3RoZXIgY29sdW1ucyBleGNlcHQgZm9yIGBZZWFyYC4gV2Ugd2lsbCBhbHNvIHJlbmFtZSB0aGUgdmFyaWFibGVzIHRvIGxvb2sgbGlrZSB0aGUgb3RoZXIgZGF0YXNldHMuCgpgYGB7cn0KY3JpbWVfZGF0YSA8LSBjcmltZV9kYXRhX3NlcCAlPiUKICBtdXRhdGUoVkFSSUFCTEUgPSAiVmlvbF9jcmltZV9jb3VudCIpICU+JQogIHJlbmFtZSgiVkFMVUUiID0gVmlvbGVudF9jcmltZV90b3RhbCkgJT4lCiAgcmVuYW1lKCJZRUFSIiA9IFllYXIpICU+JQogIHNlbGVjdChZRUFSLFNUQVRFLCBWQVJJQUJMRSwgVkFMVUUpCgpjcmltZV9kYXRhCmBgYAoKCgoKZnJvbSBNaWNoYWVsOgoKYGBge3IsIGV2YWwgPSBGQUxTRX0KY3JpbWVfZGF0YTIgPC0gZGF0YS5mcmFtZShjYmluZChjcmltZV9kYXRhMiwgcmVwKDE6KGxlbmd0aChjcmltZV9kYXRhMikvcmVwX2N5Y2xlX2N1dCksZWFjaD1yZXBfY3ljbGVfY3V0KSkpCgpjb2xuYW1lcyhjcmltZV9kYXRhKSA8LSBjKCJTdHJpbmciLCJTVEFURV9HUk9VUCIpCgpjcmltZV9kYXRhIDwtIGNyaW1lX2RhdGEgJT4lCiAgZ3JvdXBfYnkoU1RBVEVfR1JPVVApICU+JQogIGdyb3VwX3NwbGl0KCkKCmNvbHVtbnNfY3JpbWVfZGF0YSA8LSA4CgpjcmltZV9kYXRhIDwtIGNyaW1lX2RhdGEgJT4lCiAgbWFwKH5tdXRhdGUoLiwKICAgICAgICAgICAgICAgU3RhdGUgPSBjYXNlX3doZW4oc3RyX2RldGVjdChTdHJpbmcsICJFc3RpbWF0ZWQgY3JpbWUgaW4gIikgfiBzdWJzdHJpbmcoU3RyaW5nLCBuY2hhcigiRXN0aW1hdGVkIGNyaW1lIGluICIpKzEpKSwKICAgICAgICAgICAgICByb3dfaWQgPSByb3dfbnVtYmVyKCkpKSAlPiUKICBtYXAofmZpbGwoLiwgU3RhdGUpKSAlPiUKICBtYXAofmZpbHRlciguLHJvd19pZCA+IDIpKSAlPiUKICBtYXAofm11dGF0ZSguLAogICAgICAgICAgICAgIFN0cmluZyA9IHBhc3RlMChTdHJpbmcsICIsIiwgU3RhdGUpKSkgJT4lCiAgbWFwKH5kcGx5cjo6c2VsZWN0KC4sU3RyaW5nKSkgJT4lCiAgbWFwKH5zdHJfc3BsaXRfZml4ZWQoLiRTdHJpbmcsIiwiLGNvbHVtbnNfY3JpbWVfZGF0YSArIDEpKSAlPiUKICBtYXAofmRhdGEuZnJhbWUoLikpICU+JQogIG1hcCh+cmVuYW1lKC4sIllFQVIiPVgxLAogICAgICAgICAgICAgICJFeHRyYV9jb2wxIj1YMiwKICAgICAgICAgICAgICAiVkMiPVgzLAogICAgICAgICAgICAgICJFeHRyYV9jb2wyIj1YNCwKICAgICAgICAgICAgICAiRXh0cmFfY29sMyI9WDUsCiAgICAgICAgICAgICAgIkV4dHJhX2NvbDQiPVg2LAogICAgICAgICAgICAgICJFeHRyYV9jb2w1Ij1YNywKICAgICAgICAgICAgICAiRXh0cmFfY29sNiI9WDgsCiAgICAgICAgICAgICAgIlNUQVRFIj1YOSkpICU+JQogIG1hcCh+ZHBseXI6OnNlbGVjdCguLC1jb250YWlucygiRXh0cmFfY29sIikpKSAlPiUKICBtYXAofi54ICU+JSBtdXRhdGVfYWxsKH50cmltd3MoLix3aGljaCA9ICJib3RoIikpKSAlPiUKICBtYXBfZGYoYmluZF9yb3dzKQoKc2FwcGx5KGNyaW1lX2RhdGEsIGNsYXNzKQoKY3JpbWVfZGF0YSA8LSBjcmltZV9kYXRhICU+JQogIG11dGF0ZShWQVJJQUJMRSA9ICJWaW9sX2NyaW1lX2NvdW50IikgJT4lCiAgcmVuYW1lKCJWQUxVRSIgPSBWQykgJT4lCiAgYXMudGliYmxlKCkgJT4lCiAgbXV0YXRlKFlFQVIgPSBhcy5udW1lcmljKFlFQVIpLAogICAgICAgICBWQUxVRSA9IGFzLm51bWVyaWMoVkFMVUUpKQpgYGAKCjwhLS0gPC9kZXRhaWxzPiAtLT4KCiMjIFJUQyBsYXdzCgo8ZGV0YWlscz48c3VtbWFyeT4gQ2xpY2sgaGVyZSB0byBzZWUgZGV0YWlscyBhYm91dCBob3cgdGhlIFJUQyBMYXcgZGF0YSB3YXMgd3JhbmdsZWQgPC9zdW1tYXJ5PgoKClRoZSBpbmZvcm1hdGlvbiBhYm91dCB0aGUgbGF3cyBmb3IgZWFjaCBzdGF0ZSBhcmUgbG9jYXRlZCBvbiBwYWdlIDYyIG9mIHRoZSBbRG9ub2h1ZSwgZXQgYWwuXShodHRwczovL3d3dy5uYmVyLm9yZy9wYXBlcnMvdzIzNTEwLnBkZil7dGFyZ2V0PSJfYmxhbmsifSBhcnRpY2xlLCBzbyBmaXJzdCB3ZSB3aWxsIHNlbGVjdCBqdXN0IHRoaXMgcGFnZS4gV2UgY2FuIHByaW50IHBhcnQgb2YgdGhlIGNoYXJhY3RlciBzdHJpbmcgZm9yIHRoaXMgcGFnZSB1c2luZyB0aGUgYHV0aWxzYCBgc3RyKClgIGZ1bmN0aW9uIGFuZCB0aGUgYG5jYXIubWF4YCBhcmd1bWVudC4KCmBgYHtyfQpEQVdwYXBlcl9wXzYyIDwtIERBV3BhcGVyW1s2Ml1dCnN0cihEQVdwYXBlcl9wXzYyLCBuY2hhci5tYXggPSAxMDAwKQpgYGAKCiBXZSBjYW4gYWxzbyB1c2UgdGhlIGBjYXRgIGZ1bmN0aW9uIHRvIHNlZSB0aGUgZGF0YSBwcmludGVkIG5pY2VseSB0byBzZWUgd2hhdCB3ZSBhcmUgZ29pbmcgZm9yLgpgYGB7cn0KCmNhdChEQVdwYXBlcl9wXzYyKQpgYGAKCgpXZSBjYW4gc2VlIHRoYXQgdGhpcyBpcyBvbmUgY29udGludW91cyBjaGFyYWN0ZXIgc3RyaW5nLiBXZSBjYW4gc3BhcmF0ZSBpbnRvIGxpbmVzIGJhc2VkIG9uIHRoZSBwcmVzZW5jZSBvZiBgIlxuImAgaW4gdGhlIHN0cmluZyB1c2luZyB0aGUgYHN0cl9zcGxpdCgpYCBmdW5jdGlvbiBvZiB0aGUgYHN0cmluZ3JgIHBhY2thZ2UuIFdlIG5lZWQgdG8gdW5saXN0IHRoZSBkYXRhIGZpcnN0LCBhcyB0aGUgb3V0cHV0IG9mIGBzdHJfc3BsaXQoKWAgaXMgYSBsaXN0LiBGaW5hbGx5LCB3ZSBjYW4gY29udmVydCBpdCB0byBhIHRpYmJsZSB1c2luZyB0aGUgYGFzLnRpYmJsZSgpYCBmdW5jdGlvbiBvZiB0aGUgYHRpYmJsZWAgcGFja2FnZS4gIFdlIGFsc28gc2VlIHRoYXQgd2UgZG9uJ3QgbmVlZCB0aGUgZmlyc3QgbGluZSBhYm91dCB0aGUgdGFibGUuIFdlIGNhbiByZW1vdmUgdGhpcyB3aXRoIHRoZSBgc2xpY2UoKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gV2UgY2FuIGFsc28gdXNlIHRoaXMgdG8gcmVtb3ZlIHRoZSBjb2xuYW1lcyBzbyB0aGF0IHdlIGNhbiByZXBsYWNlIHRoZW0uIFRodXMgd2Ugd2lsbCB1c2UgYHNsaWNlKC0oMToyKSlgIHRvIHJlbW92ZSB0aGUgZmlyc3QgdHdvIGxpbmVzLgoKU28gd2Ugd2lsbCBzcGxpdCBhbmQgdW5saXN0KCkgdGhlIGRhdGEuCmBgYHtyfQpwXzYyIDwtIERBV3BhcGVyX3BfNjIgJT4lCiAgICBzdHJfc3BsaXQoIlxuIikgJT4lCiAgICB1bmxpc3QoKSAlPiUKICAgIGRwbHlyOjphc190aWJibGUoKSAlPiUKICAgIHNsaWNlKC0oMToyKSkKCmhlYWQocF82MikKdGFpbChwXzYyKQoKYGBgCgoKCldlIGFsc28gc2VlIGJ5IGxvb2tpbmcgYXQgdGhlIHRhaWwgdGhhdCB3ZSB3YW50IHRvIHJlbW92ZSB0aGUgbGFzdCB0d28gbGluZXMuIE9uZSBpcyBlbXB0eSBhbmQgdGhlIG90aGVyIGhhcyBvbmx5IDYzIGNoYXJhY3RlcnMsIHdoaWNoIGlzIHRoZSBsaW5lIHdpdGggdGhlIHBhZ2UgbnVtYmVyLgoKYGBge3J9CnBfNjIgJTw+JQogIHJlbmFtZShSVEMgPSB2YWx1ZSkKcF82MiAlPiUKICBtdXRhdGUoUlRDID0gbWFwX2NocihSVEMsIHN0cl9sZW5ndGgpKSAlPiV0YWlsKCkKCnBfNjJbNTMsXSAjIHBoeXNjaWFsIHBhZ2UgNjAKcF82Mls1NCxdICMgZW1wdHkgbGluZQpwXzYyICU8PiUKICAgIHNsaWNlKC1jKDUzOjU0KSkKYGBgCgpOb3cgd2Ugd2lsbCB0cnkgc3BsaXR0aW5nIGJ5IHNwYWNlcy4gV2UgY2FuIHNob3cgdGhlIG91dHB1dCB3aXRoZSB0aGUgYGZpcnN0KClgIGFuZCBgbnRoKClgIGZ1bmN0aW9ucyBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlLgoKYGBge3J9CnBfNjIgJT4lIHB1bGwoUlRDKSAlPiUgbWFwKHN0cl9zcGxpdCwgcGF0dGVybiA9ICIgIikgJT4lIGZpcnN0KCkKcF82MiAlPiUgcHVsbChSVEMpICU+JSBtYXAoc3RyX3NwbGl0LCBwYXR0ZXJuID0gIiAiKSAlPiUgbnRoKCA1KQpgYGAKCgpJbnRlcmVzdGluZywgd2UgY2FuIHNlZSB0aGF0IHRoZXJlIGFyZSBsb3RzIG9mIHNwYWNlcyBiZXR3ZWVuIHRoZSBlbGVtZW50cyBvZiB0aGUgdGFibGUgYW5kIHRoYXQgdGhleSB2YXJ5IGJ5IGxpbmUuIEZvciBleGFtcGxlIHRoZXJlIGFyZSA2IHNwYWNlcyBiZWZvcmUgQWxhYmFtYSBhbmQgNyBzcGFjZXMgYmVmb3JlIEFsYXNrYS4KCk92ZXJhbGwsIHRoYXQgZGlkbid0IHdvcmsgcXVpdGUgbGlrZSB3ZSBleHBlY3RlZC4gCgpSZWNhbGwgZnJvbSB0aGUgY2hlYXRzaGVldCB0aGF0IGAiXFxzImAgaW5kaWNhdGVzIGEgc3BhY2UuIFRoZXJlIGFyZSBhbHNvIHdheXMgdG8gc3BlY2lmeSBob3cgbWFueSBzcGFjZXMgdXNpbmcgY3VybHkgYnJhY2tldHNge31gLiAKCmBgYHtyfQprbml0cjo6aW5jbHVkZV9ncmFwaGljcyhoZXJlKCJpbWciLCAicmVnZXgucG5nIikpCmtuaXRyOjppbmNsdWRlX2dyYXBoaWNzKGhlcmUoImltZyIsICJxdWFudGlmaWVycy5wbmciKSkKYGBgCgpUaGUgc3BhY2luZyBhcHBlYXJzIHRvIHZhcnkgcXVpdGUgYSBiaXQuIFdFIGNhbiB1c2UgdGhlIGBzdHJfY291bnQoKWAgZnVuY3Rpb24gb2YgdGhlIGBzdHJpbmdyYCBwYWNrYWdlIHRvIHNlZSBob3cgb2Z0ZW4gd2UgaGF2ZSB3aGl0ZSBzcGFjZXMgbGFyZ2VyIHRoYW4gNSwgMTAsIDE1LCBvciA0MCBzcGFjZXMuCmBgYHtyfQojIGhvdyBvZnRlbiBhcmUgdGhlcmUgd2hpdGUgc3BhY2VzIHdpdGggbW9yZSB0aGFuIDUgc3BhY2VzCnBfNjIgJT4lIAogIHB1bGwoUlRDKSAlPiUgCiAgbWFwKHN0cl9jb3VudCwgcGF0dGVybiA9ICJcXHN7NSx9IikgJT4lIAogIHVubGlzdCgpCiMgaG93IG9mdGVuIGFyZSB0aGVyZSB3aGl0ZSBzcGFjZXMgd2l0aCBtb3JlIHRoYW4gMTAgc3BhY2VzCnBfNjIgJT4lIAogIHB1bGwoUlRDKSAlPiUgCiAgbWFwKHN0cl9jb3VudCwgcGF0dGVybiA9ICJcXHN7MTAsfSIpICU+JQogIHVubGlzdCgpCgojIGhvdyBvZnRlbiBhcmUgdGhlcmUgd2hpdGUgc3BhY2VzIHdpdGggbW9yZSB0aGFuIDE1IHNwYWNlcwpwXzYyICU+JSAKICBwdWxsKFJUQykgJT4lIAogIG1hcChzdHJfY291bnQsIHBhdHRlcm4gPSAiXFxzezE1LH0iKSAlPiUKICB1bmxpc3QoKQoKIyBob3cgb2Z0ZW4gYXJlIHRoZXJlIHdoaXRlIHNwYWNlcyB3aXRoIG1vcmUgdGhhbiA0MCBzcGFjZXMKcF82MiAlPiUgCiAgcHVsbChSVEMpICU+JQogIG1hcChzdHJfY291bnQsIHBhdHRlcm4gPSAiXFxzezQwLH0iKSAlPiUgCiAgdW5saXN0KCkKYGBgCgpSb3dzIHdpdGggd2hpdGUgc3BhY2VzIHdpdGggbW9yZSB0aGFuIDQwIGNvbnNlY3V0aXZlIHNwYWNlcyBpcyBsZXNzIGNvbW1vbi4gSXQgYXBwZWFycyB0byBiZSB0aGUgY2FzZSBpbiB0aGUgMXN0IGFuZCA1dGggcm93LiAKCklmIHdlIHRha2UgYSBsb29rIGF0IHRob3NlIHJvd3Mgd2UgY2FuIHNlZSB0aGF0IHRoaXMgb2NjdXJzIHdoZW4gd2UgaGF2ZSBhIG1pc3NpbmcgdmFsdWUuCgoKYGBge3J9CmNhdChEQVdwYXBlcl9wXzYyKQpgYGAKCgpTbyB3ZSB3aWxsIHJlcGxhY2Ugd2hpdGUgc3BhY2VzIHdpdGggbW9yZSB0aGFuIDQwIGNvbnNlY3V0aXZlIHNwYWNlcyB3aXRoIGBOQWAuIExldCdzIGFsc28gcmVtb3ZlIHRoZSBsZWFkaW5nIHdoaXRlIHNwYWNlcyB0aGF0IHZhcmllcyBpbmZyb250IG9mIHRoZSBzdGF0ZSBuYW1lcywgYXMgREMgZG9lcyBub3QgaGF2ZSBhbnkgYW5kIHRoaXMgY291bGQgY2F1c2UgYSBwcm9ibGVtIGxhdGVyLiBXZSB3aWxsIGFsc28gcmVwbGFjZSBhbnkgd2hpdGUgc3BhY2VzIG9mIDIgY29uc2VjdXRpdmUgc3BhY2VzIG9yIG1vcmUgLCBidXQgbGVzcyB0aGFuIDE1IHdoaXRlIHNwYWNlcyB3aXRoICJ8IiBzbyB0aGF0IHdlIGNhbiBzcGxpdCB0aGUgZGF0YSBiYXNlZCBvbiB0aGlzIHN5bWJvbC4gVGh1cyB3ZSB3aWxsIGFsc28gcHV0IHRoZXNlIGFyb3VuZCB0aGUgYE5BYCB2YWx1ZSB0aGF0IHdlIGFyZSB1c2luZyByZXBsYWNlIHRoZSB3aGl0ZSBzcGFjZXMgbWFkZSBvZiA0MCsgc3BhY2VzLiAKYGBge3J9CgpwXzYyYiA8LXBfNjIgJT4lCiAgbXV0YXRlKFJUQyA9IHN0cl9yZXBsYWNlX2FsbChwdWxsKC4sIFJUQyksICJcXHN7NDAsfSIsICJ8Ti9BfCIpKSAlPiUKICBtdXRhdGUoUlRDID1zdHJfdHJpbShwdWxsKC4sIFJUQyksIHNpZGUgPSAibGVmdCIpKSAlPiUKICBtdXRhdGUoUlRDID0gc3RyX3JlcGxhY2VfYWxsKHB1bGwoLiwgUlRDKSwgIlxcc3syLDE1fSIsICJ8IikpCmhlYWQocF82MmIpCmBgYAoKTm93IGFueXRpbWUgdGhlcmUgaXMgIG9uZSBvciBtb3JlIGAifCJgIHdlIHNob3VsZCBoYXZlIGEgY29sdW1uIGJyZWFrLiBTbyBub3cgd2Ugd2lsbCBzcGxpdCB0aGUgZGF0YSBieSB0aGlzIHN5bWJvbC4KYGBge3J9CgpwXzYyYiA8LXB1bGwocF82MmIsIFJUQykgJT4lCiAgc3RyX3NwbGl0KCAiXFx8ezEsfSIpIAoKaGVhZChwXzYyYikKYGBgCgpHcmVhdCEgTm93IHdlIHdhbnQgdG8gcHV0IG91ciBkYXRhIGluIHRpYmJsZSBmb3JtYXQuIFRvIGRvIHNvIHdlIG5lZWQgdG8gYmluZCB0aGUgcm93cyB0b2dldGhlci4gV2UgY2FuIGRvIHNvIHVzaW5nIHRoZSBiYXNlIGByYmluZCgpYCBmdW5jdGlvbi4gV2Ugd2lsbCB1c2UgdGhpcyBpbnN0ZWFkIG9mIHRoZSBgYmluZF9yb3dzKClgIGZ1bmN0aW9uIG9mIGBkcGx5cmAgYmVjYXVzZSBgcmJpbmQoKWAgaXMgbGVzcyByZXN0cmljdGl2ZSBhbmQgYWxsb3dzIGZvciBjb2x1bW5zIHdpdGhvdXQgbmFtZXMuIFdlIHdpbGwgdXNlIHRoZSBiYXNlIGBkby5jYWxsKClgIGZ1bmN0aW9uLCBzbyB0aGF0IHRoaXMgaXMgcGVyZm9ybWVkIGFsb25nIGVhY2ggY2hhcmFjdGVyIHN0cmluZyB3aXRoaW4gdGhlIGxpc3Qgb2YgYHBfNjJiYCB3aGlsZSBtYWludGFpbmluZyB0aGUgc3RydWN0dXJlLiBUaGVuIHdlIGNyZWF0ZSBhIHRpYmJsZSBvdXQgb2YgdGhpcy4gYXZvY2Fkby4uLiBkZXNjcmliZSBkby5jYWxsIGJldHRlci4uLiBtYXliZSBkbyBzb21ldGhpbmcgdGlkeXZlcnNlLi4uIAoKYGBge3J9CnBfNjIgPC0gYXMudGliYmxlKGRvLmNhbGwocmJpbmQsIHBfNjJiKSkKCmNvbG5hbWVzKHBfNjIpIDwtIGMoIlNUQVRFIiwKICAgICAgICAgICAgICAgICAgICAiRV9EYXRlX1JUQyIsCiAgICAgICAgICAgICAgICAgICAgIkZyYWNfWXJfRWZmX1lyX1Bhc3MiLAogICAgICAgICAgICAgICAgICAgICJSVENfRGF0ZV9TQSIpCgpwXzYyIDwtIHBfNjIgJT4lCiAgZHBseXI6OnNlbGVjdChTVEFURSwgUlRDX0RhdGVfU0EpICU+JQogIHJlbmFtZSgiUlRDX0xBV19ZRUFSIj0gUlRDX0RhdGVfU0EpICU+JQogIG11dGF0ZShSVENfTEFXX1lFQVIgPSBhcy5udW1lcmljKFJUQ19MQVdfWUVBUikpICU+JQogIG11dGF0ZShSVENfTEFXX1lFQVIgPSBjYXNlX3doZW4oUlRDX0xBV19ZRUFSID09IDAgfiBJbmYsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIFRSVUUgfiBSVENfTEFXX1lFQVIpKQoKUlRDIDwtcF82MgpSVEMKYGBgCgphdm9jYWRvIHdoeSBpbmY/Cgpmcm9tIE1pY2hhZWwKYGBge3IsIGV2YWwgPSBGQUxTRX0KCnBfNjJiIDwtcHVsbChwXzYyYiwgUlRDKSAlPiUKICBzdHJfc3BsaXQoICJcXHx7MSx9IikgJT4lIGFzLmRhdGEuZnJhbWUoKQogIHVubGlzdCgpCgoKCnBfNjJiIDwtcF82MiAlPiUKICBtdXRhdGUoUlRDID0gc3RyX3JlcGxhY2VfYWxsKHB1bGwoLiwgUlRDKSwgIlxcc3s0MCx9IiwgInxOL0F8IikpICU+JQogICBtdXRhdGUoUlRDID0gc3RyX3JlcGxhY2VfYWxsKHB1bGwoLiwgUlRDKSwgIlxcc3syLDE1fSIsICJ8IikpCgpwXzYyYiAlPD4lCm11dGF0ZSh2YWx1ZSA9IHN0cl9zcGxpdChwdWxsKC4sIHZhbHVlKSwgIlxcfHsxfSIpKQoKcmVhZF9jc3YocF82MmIkdmFsdWUpICAKCnBfNjIgPC0gcF82MiAlPiUKICAgIGFwcGx5KDEsc3RyX3JlcGxhY2VfYWxsLCAiXFxzezQwLH0iLCAifE4vQXwiKSAlPiUKICAgIHN0cl9yZXBsYWNlX2FsbCgiXFxzezIsMTV9IiwgInwiKSAlPiUKICAgIGFzLmRhdGEuZnJhbWUoKQoKcF82MiA8LSBzYXBwbHkocF82MiQuLCBzdHJfc3BsaXQsICJcXHx7MSx9IikKCnNhcHBseShwXzYyLCBuY2hhcikKCnBfNjIgPC0gbGFwcGx5KHBfNjIsIGZ1bmN0aW9uKHgpIHhbbmNoYXIoeCkgPiAwXSkgCgpwXzYyIDwtIGFzLmRhdGEuZnJhbWUoZG8uY2FsbChyYmluZCwgcF82MikpCgpyb3duYW1lcyhwXzYyKQoKcm93bmFtZXMocF82MikgPC0gYygpCgpjb2xuYW1lcyhwXzYyKSA8LSBjKCJTVEFURSIsCiAgICAgICAgICAgICAgICAgICAgIkVfRGF0ZV9SVEMiLAogICAgICAgICAgICAgICAgICAgICJGcmFjX1lyX0VmZl9Zcl9QYXNzIiwKICAgICAgICAgICAgICAgICAgICAiUlRDX0RhdGVfU0EiKQpzYXBwbHkocF82MiwgY2xhc3MpCgpwXzYyIDwtIHBfNjIgJT4lCiAgZHBseXI6OnNlbGVjdChTVEFURSwgUlRDX0RhdGVfU0EpICU+JQogIHJlbmFtZSgiUlRDX0xBV19ZRUFSIj1SVENfRGF0ZV9TQSkgJT4lCiAgbXV0YXRlKFJUQ19MQVdfWUVBUiA9IGFzLm51bWVyaWMoUlRDX0xBV19ZRUFSKSkgJT4lCiAgbXV0YXRlKFJUQ19MQVdfWUVBUiA9IGNhc2Vfd2hlbihSVENfTEFXX1lFQVIgPT0gMCB+IEluZiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgVFJVRSB+IFJUQ19MQVdfWUVBUikpCgpzYXBwbHkocF82MiwgY2xhc3MpCgpoZWFkKHBfNjIpCmBgYAoKIyMgSm9pbmluZyBEYXRhCgoKTm93IHdlIHdpbGwgam9pbiB0aGUgZGF0YSBmcm9tIHRoZSBkaWZmZXJlbnQgZGF0YSBzZXRzIHRvZ2V0aGVyIHRvIGNyZWF0ZSBhIHRpYmJsZSBvZiBkYXRhIGZvciBhbiBhbmFseXNpcyB0aGF0IHdpbGwgYmUgc2ltaWxhciB0byB0aGUgZGF0YSB1c2VkIGJ5IFtEb25vaHVlIGV0IGFsLl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpIHt0YXJnZXQ9Il9ibGFuayJ9IGFuZCBbTG90dCBhbmQgTXVzdGFyZF0oaHR0cHM6Ly9jaGljYWdvdW5ib3VuZC51Y2hpY2Fnby5lZHUvY2dpL3ZpZXdjb250ZW50LmNnaT9hcnRpY2xlPTExNTAmY29udGV4dD1sYXdfYW5kX2Vjb25vbWljcyl7dGFyZ2V0PSJfYmxhbmsifS4KCkZpcnN0IHdlIG5lZWQgdG8gY2hlY2sgdGhhdCBvdXIgZGF0YSBpcyBpbmRlZWQgcmVhZHkgdG8gYmUgam9pbmVkLiBXZSBuZWVkIHRvIG1ha2Ugc3VyZSB0aGF0IHRoZSBjb2x1bW4gbmFtZXMgYXJlIHRoZSBzYW1lIGZvciBlYWNoIGRhdGFzZXQgdGhhdCB3ZSBpbnRlbmQgdG8gY29tYmluZSB0b2dldGhlci4gCgpXZSB3aWxsIHVzZSB0aGUgYGNvbXBhcmVfZGZfY29scygpYCBhbmQgYGNvbXBhcmVfZGZfY29sc19zYW1lKClgIGZ1bmN0aW9ucyBvZiB0aGUgamFuaXRvciBwYWNrYWdlLCB0byBlbnN1cmUgdGhhdCB0aGUgY29sdW1uIG5hbWVzIGFyZSB0aGUgc2FtZSBhbmQgdGhhdCB0aGUgY29sdW1uIHZhbHVlcyBhcmUgdGhlIHNhbWUgdHlwZSBzbyB0aGF0IHRoZSB0aWJibGVzIGNhbiBiZSBqb2luZWQgYnkgcm93LiAKCklmIHRoZXkgY2FuIGJlIGpvaW5lZCBieSByb3csIHRoZW4gYGNvbXBhcmVfZGZfY29sc19zYW1lKClgICByZXR1cm5zIHRoZSB2YWx1ZSBgVFJVRWAsIHdoaWxlIGNvbXBhcmVfZGZfY29scygpLCBwcm92aWRlcyBhIGRlc2NyaXB0aW9uIG9mIHRoZSBjb2x1bW5zLgoKYGBge3J9CmxpYnJhcnkoamFuaXRvcikKCmRhdGFfbGlzdCA8LSAgbGlzdChkZW1fRE9OT0hVRSwKICAgICAgICAgICAgICAgIGRlbV9MT1RULAogICAgICAgICAgICAgICAgcG9wdWxhdGlvbl9kYXRhLAogICAgICAgICAgICAgICAgdWVfcmF0ZV9kYXRhLAogICAgICAgICAgICAgICAgcG92ZXJ0eV9yYXRlX2RhdGEsCiAgICAgICAgICAgICAgICBjcmltZV9kYXRhLAogICAgICAgICAgICAgICAgcHNfZGF0YSkgI3BvbGljZSBzdGFmZmluZwoKamFuaXRvcjo6Y29tcGFyZV9kZl9jb2xzX3NhbWUoZGF0YV9saXN0KQpqYW5pdG9yOjpjb21wYXJlX2RmX2NvbHMoZGF0YV9saXN0KQoKCmNoZWNrc3RhdGUgPC0gZnVuY3Rpb24oeCkgeyB4ICU8PiUgZGlzdGluY3QoU1RBVEUpICU+JSB0YWxseSgpICU+JSBwdWxsKG4pIH0KbWFwKGRhdGFfbGlzdCwgY2hlY2tzdGF0ZSkKY2hlY2t5ZWFyIDwtIGZ1bmN0aW9uKHgpIHsgeCAlPD4lIGRpc3RpbmN0KFlFQVIpICU+JSB0YWxseSgpICU+JSBwdWxsKG4pIH0KbWFwKGRhdGFfbGlzdCwgY2hlY2t5ZWFyKQpgYGAKCkF2b2NhZG8gYmluZF9yb3dzIHdpbGwgbWFrZSBuYSB2YWx1ZXMgZm9yIHRoZSBsYXRlciB5ZWFycyBiZXlvbmQgMjAxMCBmb3IgdGhlIGRhdGFzZXRzIHRoYXQgaGF2ZSB0aGVtLi4uIG5vdCBzdXJlIHdoeSB3ZSBhcmUgYWRkaW5nIHRoZXNlLi4uIG1heWJlIHRoZXJlIGlzIG1vcmUgYWJvdXQgdGhhdCBsYXRlcj8KCiMjIERvbm9odWUsIGV0IGFsLgoKV2Ugd2lsbCBub3cgYmluZCB0aGUgZGVtb2dycGFoaWMgZGF0YSB0aGF0IHdlIG1hZGUgZm9yIHRoZSBEb25vaHVlLWxpa2UgYW5hbHlzaXMgY2FsbGVkIGBkZW1fRE9OT0hVRWAsIGFzIHdlbGwgYXMgYWxsIHRoZSBvdGhlciBkYXRhc2V0cyB0aGF0IHdlIGhhdmUgd3JhbmdsZWQuIFRoaXMgaXMgcG9zc2libGUgYmVjYXVzZSB3ZSBoYXZlIHRoZSBzYW1lIGNvbG5hbWVzIGZvciBlYWNoIGRhdGFzZXQuIFdlIHdpbGwgYWxzbyB1c2UgdGhlIGBwaXZvdF93aWRlcigpYCBmdW5jdGlvbiBvZiB0aGUgYHRpZHlyYCBwYWNrYWdlIHRvIGNoYW5nZSB0aGUgc2hhcGUgb2YgdGhlIGRhdGEuIFRoaXMgd2lsbCBtYWtlIHRoZSBkYXRhIGhhdmUgbW9yZSBjb2x1bW5zLiBFYWNoIHVuaXF1ZSB2YWx1ZSBpbiB0aGUgY29sdW1uIGNhbGxlZCBgVkFSSUFCTEVgIHdpbGwgYmUgdXNlZCB0byBtYWtlIG5ldyBjb2x1bW5zLiBhbmQgdGhlIHZhbHVlcyBmb3IgZWFjaCB3aWxsIGNvbWUgZnJvbSB0aGUgY29sdW1uIGNhbGxlZCBgVkFMVUVgLgoKYGBge3J9CkRPTk9IVUVfREYgPC0gYmluZF9yb3dzKGRlbV9ET05PSFVFLAogICAgICAgICAgICAgICAgICAgICAgICB1ZV9yYXRlX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgICAgIHBvdmVydHlfcmF0ZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICAgICBjcmltZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICAgICBwb3B1bGF0aW9uX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgICAgIHBzX2RhdGEpCmhlYWQoRE9OT0hVRV9ERikKYGBgCgoKYGBge3J9CkRPTk9IVUVfREYgJTw+JQogIHBpdm90X3dpZGVyKG5hbWVzX2Zyb20gPSAiVkFSSUFCTEUiLAogICAgICAgICAgICAgIHZhbHVlc19mcm9tID0gIlZBTFVFIikKCkRPTk9IVUVfREYgJT4lCiAgc2xpY2Vfc2FtcGxlKG4gPSAxMCkgJT4lCiAgZ2xpbXBzZSgpCmBgYAoKV2Ugd2lsbCBhbHNvIGFkZCB0aGUgUmlnaHQgdG8gQ2FycnkgTGF3IGRhdGEgdXNpbmcgdGhlIGBsZWZ0X2pvaW4oKWAgZnVuY3Rpb24gb2YgdGhlIGBkcGx5cmAgcGFja2FnZS4gV2hpY2ggd2lsbCBwbGFjZSB0aGUgYERPTk9IVUVfREZgIGRhdGEgb24gdGhlIGxlZnQgb2YgdGhlIGBSVENgIGRhdGEuICBWYWx1ZXMgd2lsbCBiZSBtYXRjaGVkIGJ5IFNUQVRFLiBUaGVuIHdlIHdpbGwgY3JlYXRlIGEgbmV3IHZhcmlhYmxlIGNhbGxlZCBgUlRDX0xBV2AgdXNpbmcgdGhlIGBtdXRhdGUoKWAgZnVuY3Rpb24gYW5kIHRoZSBgY2FzZV93aGVuKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UgIHRoYXQgd2lsbCBoYXZlIHRoZSB2YWx1ZSBgVFJVRWAgaWYgdGhlIGN1cnJlbnQgeWVhciBkYXRhIGlzIGVxdWFsIHRvIG9yIGdyZWF0ZXIgdGhhbiB0aGUgeWVhciB0aGF0IGEgbW9yZSBwcmVtaXNpdmUgUlRDIGxhdyB3YXMgYWRvcHRlZCwgb3RoZXJ3aXNlIHRoZSB2YWx1ZSB3aWxsIGJlIGBGQUxTRWAuCgpgYGB7cn0KCmhlYWQoUlRDKQoKRE9OT0hVRV9ERiAlPD4lCiAgbGVmdF9qb2luKFJUQyAsIGJ5ID0gYygiU1RBVEUiKSkgJT4lCiAgbXV0YXRlKFJUQ19MQVcgPSBjYXNlX3doZW4oWUVBUiA+PSBSVENfTEFXX1lFQVIgfiBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICBUUlVFIH4gRkFMU0UpKQoKRE9OT0hVRV9ERiAlPiUKICBzbGljZV9zYW1wbGUobiA9IDEwKSAlPiUKICBnbGltcHNlKCkKYGBgCgpTaW5jZSB3ZSBoYXZlIGRpZmZlcmluZyBudW1iZXJzIG9mIHllYXJzIGZvciBlYWNoIGRhdGEgc2V0LCB3ZSBjYW4gdXNlIHRoZSBgZHJvcF9uYSgpYCBmdW5jdGlvbiBvZiB0aGUgYHRpZHlyYCBwYWNrYWdlLiB0byByZW1vdmUgeWVhcnMgdGhhdCBoYXZlIGluY29tcGxldGUgZGF0YS4gVGh1cyBhbnkgcm93IHdpdGggTkEgdmFsdWVzIHdpbGwgYmUgcmVtb3ZlZC4KCkZvciBleGFtcGxlLCB3ZSBjYW4gc2VlIHRoYXQgZm9yIDE5NzcsIGFsdGhvdXRoIHdlIGhhdmUgbW9zdCBvZiB0aGUgZGF0YSwgd2UgZG8gbm90IGhhdmUgdGhlIHBvdmVydHkgcmF0ZS4gCmBgYHtyfQpET05PSFVFX0RGICU+JQogIGZpbHRlcihZRUFSID09IDE5NzcpICU+JQogIGhlYWQoKSAlPiUKICBnbGltcHNlKCkKCmBgYAoKQW5vdGhlciBleGFtcGxlLCBpbiAyMDE4IHdlIG9ubHkgaGF2ZSBpbmZyb21hdGlvbiBhYm91dCB1bmVtcGxveW1lbnQgcmF0ZXMsIHBvdmVydHkgcmF0ZXMsIGFuZCBSVEMgbGF3cy4KCmBgYHtyfQpET05PSFVFX0RGICU+JQogIGZpbHRlcihZRUFSID09IDIwMTgpICU+JQogIGhlYWQoKSAlPiUKICBnbGltcHNlKCkKCmBgYAoKYGBge3J9CkRPTk9IVUVfREYgJTw+JQogZHJvcF9uYSgpCgpoZWFkKERPTk9IVUVfREYpICU+JSAKICBnbGltcHNlKCkKdGFpbChET05PSFVFX0RGKSAlPiUgCiAgZ2xpbXBzZSgpCgpgYGAKCk5vdyB3ZSBoYXZlIGNvbXBsZXRlIGRhdGEgYW5kIHRoZSBkYXRhIHNwYW5zIGZyb20gMTk4MCB0byAyMDEwLgoKYGBge3J9CkRPTk9IVUVfREYgJT4lIGRpc3RpbmN0KFlFQVIpICU+JSBwdWxsKFlFQVIpCmBgYAoKSWYgd2UgaW5jbHVkZSBzdGF0ZXMgdGhhdCBoYWQgYSBSVEMgbGF3IGFkb3B0ZWQgYmVmb3JlIG91ciB0aW1lIHNwYW4gb2YgZGF0YSwgc2F5IDE5NzUsIHRoZW4gd2Ugb25seSBoYXZlIGluZm9ybWF0aW9uIGFib3V0IGNyaW1lIHJhdGVzIGFuZCB0aGUgb3RoZXIgdmFyaWFibGVzIG9mIGludGVyZXN0IGFmdGVyIHRoZSBsYXcgd2FzIGFkb3B0ZWQgYnV0IG5vdCBiZWZvcmUsIHRoZXJlZm9yZSBpbmNsdWRpbmcgdGhlc2Ugc3RhdGVzIGRvZXNuJ3QgcmVhbGx5IG1ha2VzIHNlbnNlLiBUaHVzLCB3ZSB3aWxsIGRyb3AgdGhlIGRhdGEgZm9yIHRoZXNlIHN0YXRlcy4gV2UgY2FuIHVzZSB0aGUgYHNldF9kaWZmKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UgdG8gc2VlIHdoYXQgc3RhdGVzIGFyZSBpbiB0aGUgYHBvcHVsYXRpb25fZGF0YWAgdGhhdCBjb250YWlucyBhbGwgdGhlIG9yaWdpbmFsIDUxIHN0YXRlcyAocmVjYWxsIHRoaXMgaW5jbHVkZXMgdGhlIERpc3RyaWN0IG9mIENvbHVtYmlhKSBidXQgYXJlIG5vdCBpbiB0aGUgYERPTk9IVUVfREZgLiBUaGUgb3JkZXIgbWF0dGVycyBoZXJlLiBJZiB3ZSBkaWQgaXQgdGhlIG90aGVyIHdheSBhcm91bmQgd2l0aCBgcG9wdWxhdGlvbl9kYXRhYCBsaXN0ZWQgc2Vjb25kLCB0aGVuIHNldF9kaWZmIHdvdWxkIHRlc3QgaWYgdGhlcmUgYXJlIGFueSBzdGF0ZXMgaW4gYERvbm9odWVfREZgIHRoYXQgYXJlIG5vdCBpbiBgcG9wdWxhdGlvbl9kYXRhYC4gQXMgdGhlcmUgYXJlIG5vbmUgdGhpcyB3b3VsZCByZXN1bHQgaW4gbm90aGluZy4KCmBgYHtyfQpiYXNlbGluZV95ZWFyIDwtIG1pbihET05PSFVFX0RGJFlFQVIpCmNlbnNvcmluZ195ZWFyIDwtIG1heChET05PSFVFX0RGJFlFQVIpCgpET05PSFVFX0RGICU8PiUKICBtdXRhdGUoVElNRV8wID0gYmFzZWxpbmVfeWVhciwKICAgICAgICAgVElNRV9JTkYgPSBjZW5zb3JpbmdfeWVhcikgJT4lCiAgZmlsdGVyKFJUQ19MQVdfWUVBUiA+IFRJTUVfMCkKCiMgRE9OT0hVRV9ERiAlPD4lIAojICAgbXV0YXRlKFNUQVRFID0gYXMuZmFjdG9yKFNUQVRFKSkKIyAKIyBET05PSFVFX0RGICU+JSAKIyAgIHB1bGwoU1RBVEUpICU+JSAKIyAgIGxldmVscygpCgpzZXRkaWZmKGRpc3RpbmN0KHBvcHVsYXRpb25fZGF0YSwgU1RBVEUpLCAKICAgICAgICBkaXN0aW5jdChET05PSFVFX0RGLCBTVEFURSkpCmBgYAoKV2Ugd2lsbCBhbHNvIGNhbGN1bGF0ZSBhIHZpb2xlbnQgY3JpbWUgcmF0ZSByZWxhdGl2ZSB0byB0aGUgcG9wdWxhdGlvbiBpbiB0aGF0IHN0YXRlIGF0IHRoYXQgdGltZSwgbm93IHRoYXQgd2UgaGF2ZSBkYXRhIGZvciBib3RoIGNyaW1lIGNvdW50IGFuZCBwb3B1bGF0aW9uLiAgV2lsbCB3aWxsIGFsc28gY2FsY3VhdGUgdGhlIGxvZyB2YWx1ZSBvZiB0aGlzIHJhdGUgYW5kIHRoZSBwb3B1bGF0aW9uLgoKYGBge3J9CkRPTk9IVUVfREYgJTw+JQogIG11dGF0ZShWaW9sX2NyaW1lX3JhdGVfMWsgPSAoVmlvbF9jcmltZV9jb3VudCoxMDAwKS9Qb3B1bGF0aW9uLAogICAgICAgICBWaW9sX2NyaW1lX3JhdGVfMWtfbG9nID0gbG9nKFZpb2xfY3JpbWVfcmF0ZV8xayksCiAgICAgICAgIFBvcHVsYXRpb25fbG9nID0gbG9nKFBvcHVsYXRpb24pKQoKYGBgCgpGcm9tIG1pY2hhZWw6CgpgYGB7ciwgZXZhbCA9IEZBTFNFfQogRE9OT0hVRV9ERiAlPiUKICAgY291bnQoKSAlPiUKICAgZmlsdGVyKG4gIT0gNTEpICU+JQogICBwcmludChuPWRpbSguKVsxXSkKCiBzdW1tYXJ5KGFzLmZhY3RvcihET05PSFVFX0RGJFNUQVRFKSkKCiBtYXgoRE9OT0hVRV9ERiRZRUFSKSAtIG1pbihET05PSFVFX0RGJFlFQVIpICsgMQoKIERPTk9IVUVfREYgPC0gRE9OT0hVRV9ERiAlPiUKICAgbXV0YXRlKFNUQVRFID0gZmN0X2NvbGxhcHNlKFNUQVRFLCAiRGlzdHJpY3Qgb2YgQ29sdW1iaWEiPWMoIkRpc3RyaWN0IG9mIENvbHVtYmlhIiwiRC5DLiIpKSkKCiBzdW1tYXJ5KGFzLmZhY3RvcihET05PSFVFX0RGJFNUQVRFKSkKICAKbGVuZ3RoKGxldmVscyhET05PSFVFX0RGJFNUQVRFKSkKCkRPTk9IVUVfREYgPC0gRE9OT0hVRV9ERiAlPiUKICBncm91cF9ieShTVEFURSwgWUVBUikgJT4lCiAgc3VtbWFyaXNlX2FsbCh+bmEub21pdCh1bmlxdWUoLikpKSAlPiUKICB1bmdyb3VwKCkgIyBUaGlzIGlkZW50aWZpZXMgdW5pcXVlIG9ic2VydmF0aW9ucywgY29hbGVzY2VzIHJvd3MgYWNjb3JkaW5nIHRvIHRoZSBncm91cGluZyB2YXJpYWJsZShzKSwgYW5kIGdldHMgcmlkIG9mIG9mIHVuaXRzIHRoYXQgaGF2ZSBpbmNvbXBsZXRlIGRhdGEuIFRoaXMgZ2l2ZXMgcmV0dXJucyBhIGRhdGFmcmFtZSB3aXRoIHRoZSBtb3N0IGNvbXBsZXRlIGluZm9ybWF0aW9uLgoKc3VtbWFyeShhcy5mYWN0b3IoRE9OT0hVRV9ERiRTVEFURSkpIAoKYmFzZWxpbmVfeWVhciA8LSBtaW4oRE9OT0hVRV9ERiRZRUFSKQpjZW5zb3JpbmdfeWVhciA8LSBtYXgoRE9OT0hVRV9ERiRZRUFSKQoKIyBOZWVkIHRvIGZpeCB0aGlzIHRvIGVuc3VyZSBzZXZlcmUgYmlhcyBpcyBub3QgaW50cm9kdWNlZCBieSBwcmV2YWxlbnQgImNhc2VzIgoKRE9OT0hVRV9ERiA8LSBET05PSFVFX0RGICU+JQogIG11dGF0ZShUSU1FXzAgPSBiYXNlbGluZV95ZWFyLAogICAgICAgICBUSU1FX0lORiA9IGNlbnNvcmluZ195ZWFyKSAlPiUKICBmaWx0ZXIoUlRDX0xBV19ZRUFSID4gVElNRV8wKQoKRE9OT0hVRV9ERiA8LSBET05PSFVFX0RGICU+JQogIG11dGF0ZShWaW9sX2NyaW1lX3JhdGVfMWsgPSAoVmlvbF9jcmltZV9jb3VudCoxMDAwKS9Qb3B1bGF0aW9uLAogICAgICAgICBWaW9sX2NyaW1lX3JhdGVfMWtfbG9nID0gbG9nKFZpb2xfY3JpbWVfcmF0ZV8xayksCiAgICAgICAgIFBvcHVsYXRpb25fbG9nID0gbG9nKFBvcHVsYXRpb24pKQoKc3VtbWFyeShkcm9wbGV2ZWxzKGFzLmZhY3RvcihET05PSFVFX0RGJFNUQVRFKSkpCgpsZW5ndGgoc3VtbWFyeShkcm9wbGV2ZWxzKGFzLmZhY3RvcihET05PSFVFX0RGJFNUQVRFKSkpKQoKYGBgCgojIyBMb3R0IGFuZCBNdXN0YXJkCgpXZSB3aWxsIG5vdyBiaW5kIHRoZSBkZW1vZ3JwYWhpYyBkYXRhIHRoYXQgd2UgbWFkZSBmb3IgdGhlIExvdHQtbGlrZSBhbmFseXNpcyBjYWxsZWQgYGRlbV9Mb3R0YCwgYXMgd2VsbCBhcyBhbGwgdGhlIG90aGVyIGRhdGFzZXRzIHRoYXQgd2UgaGF2ZSB3cmFuZ2xlZCBqdXN0IGFzIHdlIGRpZCBmb3IgdGhlIERvbm9odWUtbGlrZSBhbmFseXNpcy4gQWdhaW4sIHRoaXMgaXMgcG9zc2libGUgYmVjYXVzZSB3ZSBoYXZlIHRoZSBzYW1lIGNvbG5hbWVzIGZvciBlYWNoIGRhdGFzZXQuIAoKYGBge3J9CkxPVFRfREYgPC0gYmluZF9yb3dzKGRlbV9MT1RULAogICAgICAgICAgICAgICAgICAgICB1ZV9yYXRlX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgIHBvdmVydHlfcmF0ZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICBjcmltZV9kYXRhLAogICAgICAgICAgICAgICAgICAgICBwb3B1bGF0aW9uX2RhdGEsCiAgICAgICAgICAgICAgICAgICAgIHBzX2RhdGEpICU+JQogIHBpdm90X3dpZGVyKG5hbWVzX2Zyb20gPSAiVkFSSUFCTEUiLAogICAgICAgICAgICAgIHZhbHVlc19mcm9tID0gIlZBTFVFIikgJT4lCiAgbGVmdF9qb2luKFJUQyAsIGJ5ID0gYygiU1RBVEUiKSkgJT4lCiAgbXV0YXRlKFJUQ19MQVcgPSBjYXNlX3doZW4oWUVBUiA+PSBSVENfTEFXX1lFQVIgfiBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICBUUlVFIH4gRkFMU0UpKSAlPiUKICAgZHJvcF9uYSgpCgoKYmFzZWxpbmVfeWVhciA8LSBtaW4oTE9UVF9ERiRZRUFSKQpjZW5zb3JpbmdfeWVhciA8LSBtYXgoTE9UVF9ERiRZRUFSKQoKTE9UVF9ERiAlPD4lCiAgbXV0YXRlKFRJTUVfMCA9IGJhc2VsaW5lX3llYXIsCiAgICAgICAgIFRJTUVfSU5GID0gY2Vuc29yaW5nX3llYXIpICU+JQogIGZpbHRlcihSVENfTEFXX1lFQVIgPiBUSU1FXzApCgpzZXRkaWZmKGRpc3RpbmN0KHBvcHVsYXRpb25fZGF0YSwgU1RBVEUpLCAKICAgICAgICBkaXN0aW5jdChMT1RUX0RGLCBTVEFURSkpCgpMT1RUX0RGICU8PiUKICBtdXRhdGUoVmlvbF9jcmltZV9yYXRlXzFrID0gKFZpb2xfY3JpbWVfY291bnQqMTAwMCkvUG9wdWxhdGlvbiwKICAgICAgICAgVmlvbF9jcmltZV9yYXRlXzFrX2xvZyA9IGxvZyhWaW9sX2NyaW1lX3JhdGVfMWspLAogICAgICAgICBQb3B1bGF0aW9uX2xvZyA9IGxvZyhQb3B1bGF0aW9uKSkKCmBgYApMZXQncyBzZWUgaG93IHRoZSBkYXRhIGNvbXBhcmVzOgoKV2Ugd2lsbCBjaGVjayB0aGUgZGltZW5zaW9ucyBvZiBlYWNoIHVzaW5nIHRoZSBiYXNlIGBkaW0oKWAgZnVuY3Rpb24KYGBge3J9CmRpbShMT1RUX0RGKQpkaW0oRE9OT0hVRV9ERikKYGBgCgpBcyBleHBlY3RlZCB0aGUgYExvdHRfREZgIGlzIDMwIGNvbHVtbnMgbGFyZ2VyLCBkdWUgdG8gdGhlIDMwIGFkZGl0aW9uYWwgZGVtb2dyYXBoaWMgdmFyaWFibGVzLiBXZSBjYW4gY2hlY2sgdGhvc2Ugbm93IGFzIHdlbGwuCgpgYGB7cn0KTE9UVF9ERiAlPiUKICAgY29sbmFtZXMoKQoKRE9OT0hVRV9ERiAlPiUKICAgY29sbmFtZXMoKQpgYGAKCkxhc3RseSwgd2Ugd2lsbCBjaGVjayB0aGF0IHRoZSBgWUVBUmAgdmFsdWVzIGFyZSB0aGUgc2FtZS4gV2UgY2FuIHVzZSB0aGUgYHNldGVxdWFsKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2UgdG8gc2VlIGlmIHRoZSB2YWx1ZXMgYXJlIHRoZSBzYW1lLiAKCmBgYHtyfQpzZXRlcXVhbChET05PSFVFX0RGICU+JSBkaXN0aW5jdChZRUFSKSwKICAgICAgICAgIExPVFRfREYgJT4lIGRpc3RpbmN0KFlFQVIpKQpgYGAKCgpMb29rcyBhcyBleHBlY3RlZCEgd2UgaGF2ZSAKCmZyb20gTWljaGFlbDoKYGBge3IsIGV2YWwgPSBGQUxTRX0KTE9UVF9ERiAlPiUKICBncm91cF9ieShZRUFSKSAlPiUKICB0YWxseSgpICU+JQogIGZpbHRlcihuICE9IDUxKSAlPiUKICBwcmludChuPWRpbSguKVsxXSkKCnN1bW1hcnkoYXMuZmFjdG9yKExPVFRfREYkU1RBVEUpKQoKbWF4KExPVFRfREYkWUVBUikgLSBtaW4oTE9UVF9ERiRZRUFSKSArIDEKCkxPVFRfREYgPC0gTE9UVF9ERiAlPiUKICBtdXRhdGUoU1RBVEUgPSBmY3RfY29sbGFwc2UoU1RBVEUsICJEaXN0cmljdCBvZiBDb2x1bWJpYSIgPSBjKCJEaXN0cmljdCBvZiBDb2x1bWJpYSIsIkQuQy4iKSkpCgpzdW1tYXJ5KGFzLmZhY3RvcihMT1RUX0RGJFNUQVRFKSkKICAKbGVuZ3RoKGxldmVscyhMT1RUX0RGJFNUQVRFKSkKCkxPVFRfREYgPC0gTE9UVF9ERiAlPiUKICBncm91cF9ieShTVEFURSwgWUVBUikgJT4lCiAgc3VtbWFyaXNlX2FsbCh+bmEub21pdCh1bmlxdWUoLikpKSAlPiUKICB1bmdyb3VwKCkgIyBUaGlzIGlkZW50aWZpZXMgdW5pcXVlIG9ic2VydmF0aW9ucywgY29hbGVzY2VzIHJvd3MgYWNjb3JkaW5nIHRvIHRoZSBncm91cGluZyB2YXJpYWJsZShzKSwgYW5kIGdldHMgcmlkIG9mIG9mIHVuaXRzIHRoYXQgaGF2ZSBpbmNvbXBsZXRlIGRhdGEuIFRoaXMgZ2l2ZXMgcmV0dXJucyBhIGRhdGFmcmFtZSB3aXRoIHRoZSBtb3N0IGNvbXBsZXRlIGluZm9ybWF0aW9uLgoKc3VtbWFyeShhcy5mYWN0b3IoTE9UVF9ERiRTVEFURSkpIAoKYmFzZWxpbmVfeWVhciA8LSBtaW4oTE9UVF9ERiRZRUFSKQpjZW5zb3JpbmdfeWVhciA8LSBtYXgoTE9UVF9ERiRZRUFSKQoKIyBOZWVkIHRvIGZpeCB0aGlzIHRvIGVuc3VyZSBzZXZlcmUgYmlhcyBpcyBub3QgaW50cm9kdWNlZCBieSBwcmV2YWxlbnQgImNhc2VzIgoKTE9UVF9ERiA8LSBMT1RUX0RGICU+JQogIG11dGF0ZShUSU1FXzAgPSBiYXNlbGluZV95ZWFyLAogICAgICAgICBUSU1FX0lORiA9IGNlbnNvcmluZ195ZWFyKSAlPiUKICBmaWx0ZXIoUlRDX0xBV19ZRUFSID4gVElNRV8wKQoKTE9UVF9ERiA8LSBMT1RUX0RGICU+JQogIG11dGF0ZShWaW9sX2NyaW1lX3JhdGVfMWsgPSAoVmlvbF9jcmltZV9jb3VudCoxMDAwKS9Qb3B1bGF0aW9uLAogICAgICAgICBWaW9sX2NyaW1lX3JhdGVfMWtfbG9nID0gbG9nKFZpb2xfY3JpbWVfcmF0ZV8xayksCiAgICAgICAgIFBvcHVsYXRpb25fbG9nID0gbG9nKFBvcHVsYXRpb24pKQoKc3VtbWFyeShkcm9wbGV2ZWxzKGFzLmZhY3RvcihMT1RUX0RGJFNUQVRFKSkpCgpsZW5ndGgoc3VtbWFyeShkcm9wbGV2ZWxzKGFzLmZhY3RvcihMT1RUX0RGJFNUQVRFKSkpKQpgYGAKCiMgKipEYXRhIEV4cGxvcmF0aW9uKioKKioqCiBMZXQncyBkbyBzb21lIHF1aWNrIHZpc3VhbGl6YXRpb25zIHRvIGdldCBhIHNlbnNlIG9mIG91ciBvdXRjb21lIG9mIGludGVyZXN0LCB0aGUgdmlvbGVudCBjcmltZSBkYXRhLiAKIApGaXJzdCB3ZSB3aWxsIHBsb3QgdGhlIHJhdGUgb2YgdmlvbGVudCBjcmltZSBvdmVyIHRpbWUgdG8gZ2V0IGEgc2Vuc2Ugb2YgdGhlIGdlbmVyYWwgdHJlbmQuCgpUbyBkbyBzbyB3ZSBuZWVkIHRvIHN1bW1hcmlzZSB0aGUgZGF0YSBmb3IgZWFjaCB5ZWFyIGFjcm9zcyBhbGwgb2YgdGhlIHN0YXRlcy4gClRodXMgd2Ugd2lsbCB1c2UgdGhlIGBncm91cF9ieSgpYCBmdW5jdGlvbiBhbmQgdGhlIGBzdW1tYXJpc2UoKWAgZnVuY3Rpb25zIHRvIGNhbGN1bGF0ZSBhbiBvdmVyYWxsIHN1bSBvZiB2aW9sZW50IGNyaW1lIHJlbGF0aXZlIHRvIHRoZSBwb3B1bGF0aW9uIGZvciBlYWNoIHllYXIuIAoKVGhlbiB3ZSB3aWxsIHVzZSB0aGUgYGdncGxvdDJgIHBhY2thZ2UgdG8gcGxvdCB0aGUgZGF0YS4gVGhlIGZpcnN0IHN0ZXAgaW4gY3JlYXRpbmcgYSBwbG90IHdpdGggdGhpcyBwYWNrYWdlIGlzIHRvIHVzZSB0aGUgYGdncGxvdCgpYCBmdW5jdGlvbiBhbmQgdGhlIGBhZXMoKWAgYXJndW1lbnQgdG8gc3BlY2lmeSB3aGF0IGRhdGEgc2hvdWxkIGJlIHBsb3R0ZWQgb24gdGhlIHgtYXhpcyBhbmQgd2hhdCBkYXRhIHNob3VsZCBiZSBwbG90dGVkIGluIG9uIHRoZSB5LWF4aXMuIFRoZW4gd2Ugc2VsZWN0IHdoYXQgdHlwZSBvZiBwbG90IHdlIHdvdWxkIGxpa2UgdG8gbWFrZSB1c2luZyBvbmUgb2YgdGhlIGBnZW9tXyooKWAgZnVuY3Rpb25zLiBQbGVhc2Ugc2VlIFt0aGlzIGNhc2Ugc3R1ZHldKGh0dHBzOi8vb3BlbmNhc2VzdHVkaWVzLmdpdGh1Yi5pby9vY3MtYnAtY28yLWVtaXNzaW9ucy8pe3RhcmdldD0iX2JsYW5rIn0gIGZvciBtb3JlIGRldGFpbHMuCgpXZSBjYW4gdXNlIHRoZSBgc2NhbGVfeF9jb250aW51b3VzKClgIGFuZCBgc2NhbGVfeV9jb250aW51b3VzKClgIGZ1bmN0aW9ucyB0byAgbW9kaWZ5IHRoZSBheGlzIGxhYmVscy4KClRoZSBgbGFicygpYCBmdW5jdGlvbiBjYW4gYmUgdXNlZCB0byBhZGQgbGFiZWxzIHRvIHRoZSBwbG90LCB3aGlsZSB0aGUgYHRoZW1lKClgIGZ1bmN0aW9uIGFsbG93cyBmb3IgbWFuaXB1bGF0aW9uIG9mIHRoZSBkZXRpYWxzIG9mIHRoZSBsYWJlbHMsIGxpa2Ugc2l6ZSBhbmQgYW5nbGUuIAoKQWxsIG9mIHRoZXNlIGZ1bmN0aW9ucyBhcmUgcGFydCBvZiB0aGUgYGdncGxvdDJgIHBhY2thZ2UuCiAKYGBge3J9CiAKIERPTk9IVUVfREYgJT4lCiAgZ3JvdXBfYnkoWUVBUikgJT4lCiAgc3VtbWFyaXNlKFZpb2xfY3JpbWVfY291bnQgPSBzdW0oVmlvbF9jcmltZV9jb3VudCksCiAgICAgICAgICAgICAgICAgIFBvcHVsYXRpb24gPSBzdW0oUG9wdWxhdGlvbiksCiAgICAgICAgICAgICAgICAgICAgLmdyb3VwcyA9ICJkcm9wIikgJT4lCiAgbXV0YXRlKFZpb2xfY3JpbWVfcmF0ZV8xMDBrX2xvZyA9IGxvZygoVmlvbF9jcmltZV9jb3VudCoxMDAwMDApL1BvcHVsYXRpb24pKSAlPiUKICBnZ3Bsb3QoYWVzKHggPSBZRUFSLCB5ID0gVmlvbF9jcmltZV9yYXRlXzEwMGtfbG9nKSkgKwogIGdlb21fbGluZSgpICsKICBzY2FsZV94X2NvbnRpbnVvdXMoYnJlYWtzID0gc2VxKDE5ODAsIDIwMTAsIGJ5ID0gMSksCiAgICAgICAgICAgICAgICAgICAgIGxpbWl0cyA9IGMoMTk4MCwgMjAxMCksCiAgICAgICAgICAgICAgICAgICAgIGxhYmVscyA9IGMoc2VxKDE5ODAsIDIwMTAsIGJ5ID0gMSkpKSArCiAgc2NhbGVfeV9jb250aW51b3VzKGJyZWFrcyA9IHNlcSg1Ljc1LCA2Ljc1LCBieSA9IDAuMjUpLAogICAgICAgICAgICAgICAgICAgICBsaW1pdHMgPSBjKDUuNzUsIDYuNzUpKSArCiAgbGFicyh0aXRsZSA9ICJDcmltZSByYXRlcyBmbHVjdHVhdGUgb3ZlciB0aW1lIiwKICAgICAgIHggPSAiWWVhciIsCiAgICAgICB5ID0gImxuKHZpb2xlbnQgY3JpbWVzIHBlciAxMDAsMDAwIHBlb3BsZSkiKSArCiAgdGhlbWVfbWluaW1hbCgpICsgCiAgdGhlbWUoYXhpcy50ZXh0LnggPSBlbGVtZW50X3RleHQoYW5nbGUgPSA5MCkpCmBgYApJbnRlcmVzdGluZyEgSXQgYXBwZWFycyB0aGF0IHRoZXJlIHdhcyBhbiBvdmVyYWxsIG5hdGlvbmFsIHBlYWsgaW4gdmlvbGVudCBjcmltZSBpbiB0aGUgZWFybHkgMTk5MHMgdGhhdCBoYXMgc2luY2UgdGhlbiBkZWNsaW5lZC4gIAoKCk5vdyBsZXQncyB0YWtlIGEgbG9vayBhdCBlYWNoIHN0YXRlLgoKV2Ugd2lsbCB1c2UgdGhlIGBnZ3JlcGVsYCBwYWNrYWdlIHRvIGFkZCB0ZXh0IHRvIHRoZSBwbG90IHVzaW5nIHRoZSBgZ2VvbV90ZXh0X3JlcGVsKClgIGZ1bmN0aW9uLiBUaGlzIGlzIGVzcGVjaWFsbHkgdXNlZnVsIHdoZW4gdGhlcmUgaXMgYWxvdCBvZiB0ZXh0LCBhcyB0aGlzIGZ1bmN0aW9uIHJlZHVjZXMgdGhlIG92ZXJsYXAgb2YgdGV4dCBsYWJlbHMuIEFnYWluIHNlZSBbdGhpcyBjYXNlIHN0dWR5XShodHRwczovL29wZW5jYXNlc3R1ZGllcy5naXRodWIuaW8vb2NzLWJwLWNvMi1lbWlzc2lvbnMvKXt0YXJnZXQ9Il9ibGFuayJ9ICBmb3IgbW9yZSBkZXRhaWxzIG9uIGhvdyB0byBhZGQgbGFiZWxzIHRvIGVsZW1lbnRzIG9mIHBsb3RzLgogCmBgYHtyfQoKRE9OT0hVRV9ERiAlPiUKICBtdXRhdGUoVmlvbF9jcmltZV9yYXRlXzEwMGtfbG9nID0gbG9nKChWaW9sX2NyaW1lX2NvdW50KjEwMDAwMCkvUG9wdWxhdGlvbikpICU+JQogIGdncGxvdChhZXMoeCA9IFlFQVIsIHkgPSBWaW9sX2NyaW1lX3JhdGVfMTAwa19sb2csIGNvbG9yID0gU1RBVEUpKSArCiAgZ2VvbV9wb2ludChzaXplID0gMC41KSArCiAgZ2VvbV9saW5lKGFlcyhncm91cD1TVEFURSksCiAgICAgICAgICAgIHNpemUgPSAwLjUsCiAgICAgICAgICAgIHNob3cubGVnZW5kID0gRkFMU0UpICsKICBnZW9tX3RleHRfcmVwZWwoZGF0YSA9IERPTk9IVUVfREYgJT4lCiAgICAgICAgICAgICAgbXV0YXRlKFZpb2xfY3JpbWVfcmF0ZV8xMDBrX2xvZyA9IGxvZygoVmlvbF9jcmltZV9jb3VudCoxMDAwMDApL1BvcHVsYXRpb24pKSAlPiUKICAgICAgICAgICAgICBmaWx0ZXIoWUVBUiA9PSBsYXN0KFlFQVIpKSwKICAgICAgICAgICAgYWVzKGxhYmVsID0gU1RBVEUsCiAgICAgICAgICAgICAgICB4ID0gWUVBUiwKICAgICAgICAgICAgICAgIHkgPSBWaW9sX2NyaW1lX3JhdGVfMTAwa19sb2cpLAogICAgICAgICAgICBzaXplID0gMywKICAgICAgICAgICAgYWxwaGEgPSAxLAogICAgICAgICAgICBudWRnZV94ID0gMTAsCiAgICAgICAgICAgIGRpcmVjdGlvbiA9ICJ5IiwKICAgICAgICAgICAgaGp1c3QgPSAxLAogICAgICAgICAgICB2anVzdCA9IDEsCiAgICAgICAgICAgIHNlZ21lbnQuc2l6ZSA9IDAuMjUsCiAgICAgICAgICAgIHNlZ21lbnQuYWxwaGEgPSAwLjI1LAogICAgICAgICAgICBmb3JjZSA9IDEsCiAgICAgICAgICAgIG1heC5pdGVyID0gOTk5OSkgKwogIGd1aWRlcyhjb2xvciA9IEZBTFNFKSArCiAgc2NhbGVfeF9jb250aW51b3VzKGJyZWFrcyA9IHNlcSgxOTgwLCAyMDE1LCBieSA9IDEpLAogICAgICAgICAgICAgICAgICAgICBsaW1pdHMgPSBjKDE5ODAsIDIwMTUpLAogICAgICAgICAgICAgICAgICAgICBsYWJlbHMgPSBjKHNlcSgxOTgwLCAyMDEwLCBieSA9IDEpLCByZXAoIiIsIDUpKSkgKwogIHNjYWxlX3lfY29udGludW91cyhicmVha3MgPSBzZXEoMy41LCA4LjUsIGJ5ID0gMC41KSwKICAgICAgICAgICAgICAgICAgICAgbGltaXRzID0gYygzLjUsIDguNSkpICsKICBsYWJzKHRpdGxlID0gIlN0YXRlcyBoYXZlIGRpZmZlcmVudCBsZXZlbHMgb2YgY3JpbWUiLAogICAgICAgeCA9ICJZZWFyIiwKICAgICAgIHkgPSAibG4odmlvbGVudCBjcmltZXMgcGVyIDEwMCwwMDAgcGVvcGxlKSIpICsKICB0aGVtZV9taW5pbWFsKCkgKwogIHRoZW1lKGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gOTApKQoKCmBgYAoKTG9va3MgbGlrZSB0aGUgY3JpbWUgcmFnZXMgdmFyeSBxdWl0ZSBhIGJpdCBmcm9tIG9uZSBzdGF0ZSB0byBhbm90aGVyLiBTb21lIHN0YXRlcyBzaG93IGluY3JlYXNlZCBjcmltZSBvdmVyIHRpbWUgd2hpbGUgb3RoZXJzIHNob3cgZGVjcmVhc2VkIGNyaW1lLiAKCgpOb3cgbGV0J3MgdGFrZSBhIGNsb3NlciBsb29rIGF0IHNvbWUgb2Ygb3VyIG90aGVyIHZhcmlhYmxlcy4KCldlIGNhbiBhbHNvIHVzZSB0aGUgYHZpc19taXNzKClgIGZ1bmN0aW9uIG9mIHRoZSBgbmFuaWFyYCBwYWNrYWdlIHRvIGNvbmZpcm0gdGhhdCB0aGVyZSBhcmUgbm8gbWlzc2luZyB2YWx1ZXMuCgpgYGB7cn0KRE9OT0hVRV9ERiAlPiUKICBuYW5pYXI6OnZpc19taXNzKCkKCmBgYAoKTG9va3MgbGlrZSBubyBtaXNzaW5nIGRhdGEhIAoKYGBge3J9CkxPVFRfREYgJT4lCiAgbmFuaWFyOjp2aXNfbWlzcygpCgpgYGAKU2FtZSBmb3IgdGhlIGBMT1RUX0RGYC4KCldlIGNhbiB1c2UgdGhlIGBza2ltKClgIG9mIHRoZSBgc2tpbXJgIHBhY2thZ2UgdG8gZ2V0IGEgYmV0dGVyIHNlbnNlIG9mIHRoZSBkYXRhLiBUaGlzIGFsc28gc2hvd3MgbWlzc2luZ2luZ25lc3MsIGFzIHdlbGwgYXMgc3RhbmRhcmQgZGV2aWF0aW9ucywgc3ByZWFkLCBhbmQgbWVhbnMgZm9yIG91ciBkYXRhLiBBbHNvIG5vdGljZSB0aGF0IHRoZXJlIGlzIGEgaGlzdG9ncmFtIG9mIGVhY2ggdmFyaWFibGUuCgpgYGB7cn0Kc2tpbXI6OnNraW0oRE9OT0hVRV9ERikKc2tpbXI6OnNraW0oTE9UVF9ERikKCmBgYAoKIyAqKkRhdGEgQW5hbHlzaXMqKgoqKioKCiMjIERvbm9odWUsIGV0IGFsLgoKT0shIFdlIGFyZSBub3cgcmVhZHkgdG8gc3RhcnQgYW5hbHl6aW5nIG91ciBkYXRhIS4gCgpXZSBoYXZlIHdoYXQgaXMgY2FsbGVkIFtwYW5lbCBkYXRhXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9QYW5lbF9kYXRhKXt0YXJnZXQ9Il9ibGFuayJ9IC4gVGhpcyBpcyBhIHNwZWNpYWwgdHlwZSBvZiBsb25naXR1bmRpbmFsIGRhdGEuIExvbmdpdHVkaW5hbCBkYXRhIGFyZSBkYXRhIG1lYXN1cm1lbnRzIHRha2VuIG92ZXIgdGltZS4gUGFuZWwgZGF0YSBhcmUgZGF0YSByZXBlYXRpZGx5IG1lYXN1cmVkIGZvciBmb3IgbXVsdGlwbGUgcGFuZWwgbWVtYmVycyBvciBpbmRpdmlkdWFscyBvdmVyIHRpbWUuIFRoaXMgaXMgaW4gY29udHJhc3Qgd2l0aCB0aW1lIHNlcmllcyBkYXRhLCB3aGljaCBtZWFzdXJlcyBvbmUgaW5kaXZpZHVhbCBvdmVyIHRpbWUgYW5kIGNyb3NzIHNlY3Rpb25hbCBkYXRhLCB3aGljaCBtZWFzdXJlcyBtdWx0aXBsZSBpbmRpdmlkdWFscyBhdCBvbmUgcG9pbnQgaW4gdGltZS4gIEluIG90aGVyd29yZHMsIHBhbmVsIGRhdGEgaXMgYSBjb21iaW5hdGlvbiBvZiBib3RoLCBpbiB0aGlzIGNhc2Ugd2UgbWVhc3VyZSBtdWx0aXBsZSBpbmRpdmlkdWFscyBvdmVyIG11bHRpcGxlIHRpbWUgcGVyaW9kcy4gIEluIG91ciBjYXNlLCB3ZSBoYXZlIG1lYXN1cmVtZW50cyBvZiB2aW9sZW50IGNyaW1lIGFuZCBvdGhlciB2YXJpYWJsZXMgZm9yIGVhY2ggc3RhdGUgb3ZlciBtYW55IHllYXJzLiBUaGVyZWZvcmUgd2UgYXJlIHVzaW5nIG1lYXN1cmVtZW50cyBhYm91dCB0aGUgc2FtZSBzdGF0ZXMgb3ZlciB0aW1lLiAgCgpJbiBhIHBhbmVsIGFuYWx5c2lzIHRoZXJlIGFyZSAkTiQgaW5kaXZpZHVhbCBwYW5lbCBtZW1iZXJzIGFuZCAkVCQgdGltZSBwb2ludHMuICAKClRoZXJlIGFyZSB0d28gdHlwZXMgb2YgcGFuZWxzOiAgCjEuICoqQmFsYW5jZWQqKiAtIEF0IGVhY2ggdGltZSBwb2ludCAoJFQkKSwgdGhlcmUgYXJlIGRhdGEgcG9pbnRzIGZvciBlYWNoIGluZGl2aWR1YWwoJE4kKS4gCgpUaW1lIFBvaW50cyAoJFQkKSAgfCBJbmRpdmlkdWFscyAoJE4kKSAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAKLS0tLS0tLS0tLSB8LS0tLS0tLS0tLS0tLQoxOTc3ICB8IE5hdmFkYSAKMTk3NyAgfCBBbGFiYW1hCjE5NzcgIHwgS2Fuc2FzCjE5NzggfCBOZXZhZGEKMTk3OCB8IEFsYWJhbWEKMTk3OCAgfCBLYW5zYXMKMTk3OSB8IE5ldmFkYQoxOTc5IHwgQWxhYmFtYQoxOTc5IHwgS2Fuc2FzCgoyLiAqKlVuYmFsYW5jZWQqKiAtIFRoZXJlIG1heSBiZSBkYXRhIHBvaW50cyBtaXNzaW5nIGZvciBzb21lIGluaWRpdmlkdWFscyAoJE4kKSBhdCBzb21lIHRpbWUgcG9pbnRzICgkVCQpLgoKVGltZSBQb2ludHMgKCRUJCkgIHwgSW5kaXZpZHVhbHMgKCROJCkgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCi0tLS0tLS0tLS0gfC0tLS0tLS0tLS0tLS0KMTk3NyAgfCBOYXZhZGEgCjE5NzcgIHwgQWxhYmFtYQoxOTc4IHwgTmV2YWRhCjE5NzggfCBBbGFiYW1hCjE5NzkgfCBOZXZhZGEKMTk3OSB8IEFsYWJhbWEKMTk3OSB8IEthbnNhcwoKCk92ZXJhbGwgaW4gYSBhIGJhbGFuY2VkIHBhbmVsLCB3ZSBoYXZlICRuJCBvYnNlcnZhdGlvbnMsIHdoZXJlICRuID0gTipUJC4gIAoKSW4gYW4gdW5iYWxhbmNlZCBwYW5lbCwgdGhlIG51bWJlciBvZiBvYnNlcnZhdGlvbnMgaXMgbGVzcyB0aGFuICROKlQkLgoKCkluIG91ciBjYXNlIHdlIGhhdmU6ICAKJE4kID0gNDUgc3RhdGVzIChyZWNhbGwgdGhhdCB3ZSByZW1vdmVkIHRob3NlIHdobyBoYWQgYWRvcHRlZCBhIFJUQyBsYXcgYmVmb3JlIDE5ODApICAKJFQkID0gIDMxIHllYXJzICgxOTgwIC0gMjAxMCkgIAoKSW4gZXZlcnkgeWVhciB3ZSBoYXZlIG1lYXN1cmVtZW50cyBmb3IgZWFjaCBzdGF0ZSAoYXMgd2UganVzdCBzYXcgYWJvdmUpLCB0aHVzIG91ciBwYW5lbCBpcyBiYWxhbmNlZC4KClNvLCBvdXIgdG90YWwgb2JzZXJ2YXRpb25zICRuID0gNDUqMzEkLCB0aHVzICRuJCA9IGByIDQ1KjMxYC4gIAoKCgpXZSB3aWxsIGJlIHBlcmZvcm1pbmcgYSAqKnBhbmVsIGxpbmVhciByZWdyZXNzaW9uIG1vZGVsIGFuYWx5c2lzKiouIAoKCkluIHN1Y2ggYW4gYW5hbHlzaXMgd2Ugd2lsbCBtb2RlbCBvdXIgZGF0YSBhY2NvcmRpbmcgdG8gdGhpcyBnZW5lcmljIG1vZGVsOgoKJCRZX3tpdH0gPSBhICsgQidYX3tpdH0gKyB1X3tpdH0sXFwgdV97aXR9PVxtdSBfe2l9K3Zfe2l0fSQkCldoZXJlICRpJCBpcyB0aGUgaW5kaXZpZHVhbCBkaW1lbnNpb24gKGluIG91ciBjYXNlIGluZGl2aWR1YWwgc3RhdGVzKSBhbmQgJHQkIGlzIHRoZSB0aW1lIGRpbWVuc2lvbi4KClNvbWUgaW5kZXBlbmRlbnQgdmFyaWFibGVzIG9yIHJlZ3Jlc3NvcnMgJFhfe2l0fSQgd2lsbCB2YXJ5IGFjcm9zcyBpbmRpdmlkdWFscyBhbmQgdGltZSwgd2hpbGUgb3RoZXJzIHdpbGwgYmUgZml4ZWQgYWNyb3NzIHRoZSB0aW1lIG9mIHRoZSBzdHVkeSAob3IgZG9uJ3QgY2hhbmdlIG92ZXIgdGltZSksIHdoaWxlIG90aGVycyBzdGlsbCB3aWxsIGJlIGZpeGVkIGFjcm9zcyBpbmRpdmlkdWFscyBidXQgdmFyeSBhY3Jvc3MgdGltZSBwZXJpb2RzLgoKJFxtdSBfe2l9JCBhcmUgaW5kaXZpZHVhbCBlZmZlY3RzIHRoYXQgYXJlIHRpbWUgaW5kZXBlbmRlbnQgKGFrYS4gZml4ZWQgb3ZlciB0aW1lKS4gIAoKJHZfe2l0fSQgYXJlIHJhbmRvbSBlZmZlY3RzIHRoYXQgdmFyeSB3aXRoIHRpbWUgIAoKClRoZXJlIGFyZSB0aHJlZSBnZW5lcmFsIHN1YnR5cGVzIG9mIFtwYW5lbCByZWdyZXNzaW9uIGFuYWx5c2lzXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9QYW5lbF9hbmFseXNpcyl7dGFyZ2V0PSJfYmxhbmsifS4KCk92ZXJhbGwsIHRoZXkgYXNzdW1lIHRoYXQgdGhlIGRpZmZlcmVudCBpbmRpdmlkdWFscyBhcmUgaW5kZXBlbmRlbnQsIGhvd2V2ZXIgdGhlIHNhbWUgZGF0YSBmb3IgdGhlIHNhbWUgaW5kaXZpZHVhbCBtYXkgYmUgY29ycmVsYXRlZCBhY3Jvc3MgdGltZS4KClRoZSBtYWluIGRpZmZlcmVuY2UgYmV0d2VlbiB0aGUgdGhyZWUgc3VidHlwZXMgYXJlIHRoZSBhc3N1bXB0aW9ucyBhYm91dCB1bm9ic2VydmVkIGRpZmZlcmVuY2VzIGJldHdlZW4gaW5kaXZpZHVhbHMuCiAgCjEpICoqaW5kZXBlbmRlbnRseSBwb29sZWQgcGFuZWxzKiogIC0gYXNzdW1lcyB0aGF0IHRoZXJlIGFyZSBubyBpbmRpdmlkdWFsIGVmZmVjdHMgdGhhdCBhcmUgaW5kZXBlbmRlbnQgb2YgdGltZSBhbmQgYWxzbyBubyBlZmZlY3Qgb2YgdGltZSBvbiBhbGwgdGhlIGluZGl2aWR1YWxzLiBJbiBvdGhlcndvcmRzLCB0aGUgaW5kZXBlbmRlbnQgdmFyaWFibGVzIGFyZSBub3QgY29ycmVsYXRlZCB3aXRoIGFueSBlcnJvciB0ZXJtLiBUaGlzIGlzIGVzc2VudGlhbGx5IGFuIG9yZGluYXJ5IGxlYXN0IHNxdWFyZXMgbGluZWFyIHJlZ3Jlc3Npb24uIFRoaXMgdHlwZSBvZiBwYW5lbCByZWdyZXNzaW9uIG1ha2VzIHRoZSBtb3N0IGFzc3VtcHRpb25zIGFuZCBpcyB0aGVyZWZvcmUgdHlwaWNhbGx5IG5vdCB1c2VkIGZvciBwYW5lbCBkYXRhLgoKMikgKipmaXhlZCBlZmZlY3RzKiogLSBhc3N1bWVzIHRoYXQgdGhlcmUgYXJlIHVua25vd24gb3IgdW5vYnNlcnZlZCB1bmlxdWUgYXNwZWN0cyBhYm91dCB0aGUgaW5kaXZpZHVhbHMgIG9yIGhldGVyb2dlbmVpdHkgYW1vbmcgaW5kaXZ1ZGFscyAkYV9pJCB0aGF0IGFyZSBub3QgZXhwbGFpbmVkIGJ5IHRoZSBpbmRlcGVuZGVudCB2YXJpYWJsZXMgYnV0IGluZmx1ZW5jZSB0aGUgb3V0Y29tZSB2YXJpYWJsZSBvZiBpbnRlcmVzdC4gVGhleSBkbyBub3QgdmFyeSB3aXRoIHRpbWUgb3IgaW4gb3RoZXJ3b3JkcyBhcmUgZml4ZWQgb3ZlciB0aW1lIGJ1dCBtYXkgYmUgKipjb3JyZWxhdGVkKiogd2l0aCBpbmRlcGVuZGVudCB2YXJpYWJsZXMgJFhfe2l0fSQuICAKCkluIHRoaXMgY2FzZSB0aGUgaW50ZXJjZXB0IGNhbiBiZSBkaWZmZXJlbnQgZm9yIGVhY2ggaW5kaXZ1ZHVhbCAke2FfaX0kLCBidXQgdGhlIHNsb3BlIGlzIHRoZSBzYW1lIGFjcm9zcyBhbGwgdGhlIGluZGl2aWR1YWxzLgoKVGhlc2UgaW5kaXZpZHVhbCAkYV9pJCBlZmZlY3RzIGNhbiBiZSBjb3JyZWxhdGVkIHdpdGggdGhlIGluZGVwZW5kZW50IHZhcmlhYmxlcyAkWCQuCgokJFlfe2l0fSA9IGFfaSArIEInWF97aXR9ICsgdV97aXR9LFxcIHVfe2l0fT1cbXUgX3tpfSt2X3tpdH0kJApUaGlzIHR5cGUgb2YgcGFuZWwgcmVncmVzc2lvbiBtYWtlcyB0aGUgbGVhc3QgYXNzdW1wdGlvbnMuCgoKMykgKipyYW5kb20gZWZmZWN0cyoqIC0gYXNzdW1lcyB0aGF0IHRoZXJlIGFyZSB1bmtub3duIG9yIHVub2JzZXJ2ZWQgdW5pcXVlIHF1YWxpdGllcyBhYm91dCB0aGUgaW5kaXZpZHVhbHMgdGhhdCBpbmZsdWVuY2VzIHRoZSBvdXRjb21lIHZhcmlhYmxlIG9mIGludGVyZXN0IHRoYXQgYXJlICoqbm90IGNvcnJlbGF0ZWQqKiB3aXRoIHRoZSBpbmRlcGVuZGVudCB2YXJpYWJsZXMuIAoKVGh1cywgdGhlIHJhbmRvbSBlZmZlY3RzIG1vZGVsIGFjdHVhbGx5IG1ha2VzICoqbW9yZSBhc3N1bXB0aW9ucyoqIHRoYW4gdGhlIGZpeGVkIGVmZmVjdCBtb2RlbC4KCiQkWV97aXR9ID0gIEInWF97aXR9ICsgKGFfaSArIGVfe2l0fSl9JCQKU28gZWFjaCBpbmRpdnVhbCBoYXMgdGhlIHNhbXBlIHNsb3BlIGFuZCB0aGUgc2FtZSBvdmVyYWxsIGVycm9yIHRlcm0gKGFfaSArIGVfe2l0fSkuIAoKClNlZSBbaGVyZV0oaHR0cHM6Ly93d3cuYmF1ZXIudWguZWR1L3JzdXNtZWwvcGhkL2VjMS0xNS5wZGYpIGFuZCBbaGVyZV0oaHR0cHM6Ly9zaXRlcy5nb29nbGUuY29tL3NpdGUvZWNvbm9tZXRyaWNzYWNhZGVteS9lY29ub21ldHJpY3MtbW9kZWxzL3BhbmVsLWRhdGEtbW9kZWxzKSBmb3IgbW9yZSBpbmZvcm1hdGlvbiBhYm91dCB0aGVzZSBkaWZmZXJlbnQgbW9kZWxzLgoKV2Ugd2lsbCBiZSBwZXJmb3JtaW5nIGEgZml4ZWQgZWZmZWN0IHBhbmVsIHJlZ3Jlc3Npb24gYW5hbHlzaXMsIGFzIHdlIGRvIGluIGZhY3QgdGhpbmsgdGhhdCBzb21lIG9mIHRoZSB1bm9ic2VydmVkIHF1YWxpdGllcyBhYm91dCB0aGUgZGlmZmVyZW50IHN0YXRlcyB0aGF0IG1heSBiZSBjb3JyZWxhdGVkIHdpdGggc29tZSBvZiBvdXIgaW5kZXBlbmRlbnQgdmFyaWFibGVzLiBGb3IgZXhhbXBsZSwgdGhlIGxldmVsIG9mIGVjb25vbWljIG9wcG9ydHVuaXR5IG1pZ2h0IGJlIGFuIHVub2JzZXJ2ZWQgZmVhdHVyZSBhYm91dCB0aGUgc3RhdGVzIHRoYXQgaW5mbHVlbmNlcyB2aW9sZW50IGNyaW1lIHJhdGUgYW5kIHdvdWxkIGJlIHBvc3NpYmx5IGNvcnJlbGF0ZWQgd2l0aCBwb3ZlcnR5IHJhdGUgYW5kIHVuZW1wbG95bWVudC4gCgoKYXZvY2FkbzpXZSBhc3N1bWUgdGhhdCBkYXRhIGZvciB0aGUgc2FtZSBpbmRpdmlkdWFsIG1heSBiZSBjb3JyZWxhdGVkLCBidXQgd2UgYXNzdW1lIHRoYXQgdGhlIGRpZmZlcmVudCBpbmRpdnVkYWxzIGFyZSBpbmRlcGVuZGVudC4KCgphdm9jYWRvIGZyb20gTWljaGFlbDpTb21lIGNvZGUgdGFrZW4gZnJvbSBodHRwOi8va2FydGh1ci5vcmcvMjAxOS9pbXBsZW1lbnRpbmctZml4ZWQtZWZmZWN0cy1wYW5lbC1tb2RlbHMtaW4tci5odG1sCgpUbyBwZXJmb3JtIG91ciBhbmFseXNpcyB3ZSB3aWxsIGJlIHVzaW5nIHRoZSBgcGxtYCBwYWNrYWdlLiBUaGlzIHN0YW5kcyBmb3IgUGFuZWwgTGluZWFyIE1vZGVsLgoKV2UgbmVlZCB0byB1c2UgYSBzcGVjaWFsIHR5cGUgb2YgZGF0YSB0byB1c2UgdGhpcyBwYWNrYWdlLCBjYWxsZWQgYSBgcGRhdGEuZnJhbWVgIHdoaWNoIGlzIHNob3J0IGZvciBwYW5lbCBkYXRhIGZyYW1lLiBUaGlzIGFsbG93cyB1cyB0byBzcGVjaWZ5IHRoYXQgd2UgYXJlIHVzaW5nIHBhbmVsIGRhdGEgYW5kIHdoYXQgdGhlIHBhbmVsIHN0cnVjdHVyZSBsb29rcyBsaWtlLiAKCldlIG5lZWQgdG8gaW5kaWNhdGUgdmFyaWFibGUgc2hvdWxkIGJlIHVzZWQgdG8gaWRlbnRpZnkgdGhlIGluZGl2aWR1YWxzIGluIG91ciBwYW5lbCwgYW5kIHdoYXQgdmFyaWFibGUgc2hvdWxkIGJlIHVzZWQgdG8gaWRlbnRpZnkgdGhlIHRpbWUgcGVyaW9kcyBpbiBvdXIgcGFuZWwuIEluIG91ciBjYXNlIHRoZSBgU1RBVEVgIHZhcmlhYmxlIGlkZW50aWZpZXMgdGhlIGluZGl2aWR1YWxzIGFuZCB0aGUgYFlFQVJgIHZhcmlhYmxlIGlkZW50aWZpZXMgdGhlIHRpbWUgcGVyaW9kcy4KCldlIGNhbiBzcGVjaWZ5IHRoaXMgc3RydWN0dXJlIHVzaW5nIHRoZSBgcGRhdGEuZnJhbWUoKWAgZnVuY3Rpb24gb2YgdGhlIGBwbG1gIHBhY2thZ2UsIGJ5IHVzaW5nIHRoZSBgaW5kZXhgIGFyZ3VtZW50LCB3aGVyZSB0aGUgaW5kaXZpZHVhbCB2YXJpYWxlIGlzIHNwZWNpZmllZCBmaXJzdCBmb2xsb3dlZCBieSB0aGUgdGltZSB2YXJpYWJsZSwgbGlrZSBzbzogYGluZGV4PWMoIkluZGl2aWR1YWxfVmFyaWFibGVfTkFNRSIsICJUaW1lX1BlcmlvZF9WYXJpYWJsZV9OQU1FIikuCgpgYGB7cn0KZF9wYW5lbF9ET05PSFVFIDwtIHBkYXRhLmZyYW1lKERPTk9IVUVfREYsIGluZGV4PWMoIlNUQVRFIiwgIllFQVIiKSkKCmNsYXNzKGRfcGFuZWxfRE9OT0hVRSkKCnNsaWNlX2hlYWQoZF9wYW5lbF9ET05PSFVFLCBuID0gMykKYGBgCgpJbmRlZWQgd2UgaGF2ZSBub3cgY3JlYXRlZCBhIHBkYXRhLmZyYW1lIG9iamVjdCBhbmQgd2UgY2FuIHNlZSB0aGF0IHRoZSByb3cgbmFtZXMgc2hvdyB0aGUgaW5kaXZpZHVhbCBzdGF0ZXMgYW5kIHRpbWUgcGVyaW9kIHllYXJzLgoKT0ssIG5vdyB3ZSBhcmUgcmVhZHkgdG8gcnVuIG91ciBwYW5lbCBsaW5lYXIgbW9kZWwgb24gb3VyIHBhbmVsIGRhdGEgZnJhbWUuIAoKVG8gZG8gc28gd2Ugd2lsbCB1c2UgdGhlIGBwbG0oKWAgZnVuY3Rpb24gYW5kIHdlIHdpbGwgc3BlY2lmeSB0aGUgZm9ybXVsYSBmb3Igb3VyIG1vZGVsLCB3aGVyZSB0aGUgZGVwZW5kZW50IHZhcmlhYmxlIGBWaW9sX2NyaW1lX3JhdGVfMWtfbG9nYCB3aWxsIGJlIG9uIHRoZSBsZWZ0IG9mIG91ciBgfmAgc2lnbiBhbmQgYWxsIG9mIHRoZSBpbmRlcGVuZGVudCB2YXJpYWJsZXMgd2lsbCBiZSBsaXN0ZWQgb24gdGhlIHJpZ2h0IHdpdGggYCtgIHNpZ25zIGluIGJldHdlZW4gZWFjaC4KCldlIGFsc28gbmVlZCB0byBzcGVjaWZ5IHdoYXQgdHlwZSBvZiBgZWZmZWN0YCB3ZSB3b3VsZCBsaWtlIHRvIG1vZGVsIGFuZCB3aGF0IHR5cGUgb2YgYG1vZGVsYCB3ZSB3b3VsZCBsaWtlIHRvIHVzZS4KClRoZXJlIGFyZSB0aHJlZSBtYWluIG9wdGlvbnMgZm9yIHRoZSBgZWZmZWN0YCBhcmd1bWVudDoKMSkgaW5kaXZpZHVhbCAgLSBtb2RlbCBmb3IgdGhlIGVmZmVjdCBvZiBpbmRpdnVkYWwgaWRlbnRpdHkKMikgdGltZSAtIG1vZGVsIGZvciB0aGUgZWZmZWN0IG9mIHRpbWUKMykgdHdvd2F5cyAtIG1lYW5pbmcgbW9kZWxpbmcgZm9yIHRoZSBlZmZlY3Qgb2YgYm90aCBpbmRpdmlkdWFsIGlkZW50aXR5IGFuZCB0aW1lICAKClRoZXJlIGFyZSBmb3VyIG1haW4gb3B0aW9ucyBmb3IgdGhlIGBtb2RlbGAgYXJndW1lbnQ6ICAKMSkgcG9vbGluZyAtIHN0YW5kYXJkIHBvb2xlZCBvcmRpbmFyeSBsZWFzdCBzcXVhcmVzIHJlZ3Jlc3Npb24gbW9kZWwgIAoyKSB3aXRoaW4gLSBmaXhlZCBlZmZlY3RzIG1vZGVsICh2YXJpYXRpb24gYmV0d2VlbiBpbmRpdmlkdWFscyBpcyBpZ25vcmVkLCBtb2RlbCBjb21wYXJlcyBpbmRpdmlkdWFscyB0byB0aGVtc2VsdmVzIGF0IGRpZmZlcmVudCBwZXJpb2RzIG9mIHRpbWUpICAKMykgYmV0d2VlbiAtIGZpeGVkIGVmZmVjdHMgbW9kZWwgKHZhcmlhdGlvbiB3aXRoaW4gaW5kaXZpZHVhbHMgZnJvbSBvbmUgdGltZSBwb2ludCB0byBhbm90aGVyIGlzIGlnbm9yZWQsIG1vZGVsIGNvbXBhcmVzIGRpZmZlcmVudCBpbmRpdmlkdWFscyBhdCBlYWNoIHBvaW50IG9mIHRpbWUpICAKNCkgcmFuZG9tIC0gcmFuZG9tIGVmZmVjdHMgKGVhY2ggc3RhdGUgaGFzIGEgZGlmZmVyZW50IGludGVyY2VwdCBidXQgZm9yY2UgaXQgdG8gZm9sbG93IGEgbm9ybWFsIGRpc3RyaWJ1dGlvbiAtIHJlcXVpcmVzIG1vcmUgYXNzdW1wdGlvbnMpCgpUeXBpY2FsbHkgaXQgaXMgYmVzdCB0byB0aGluayBhYm91dCB3aGF0IHlvdSBhcmUgdHJ5aW5nIHRvIGV2YWx1YXRlIHdpdGggeW91ciBkYXRhIGluIHRyeWluZyB0byBjaG9vc2UgaG93IHRvIG1vZGVsIHlvdXIgZGF0YS4gSG93ZXZlciwgdGhlcmUgYXJlIGFsc28gc29tZSB0ZXN0cyB0aGF0IGNhbiBoZWxwIHRvIGFzc2VzcyB0aGlzIHdoaWNoIHdlIHdpbGwgYnJpZWZseSBjb3Zlci4KCldlIGFyZSBpbnRlcmVzdGVkIGluIGhvdyB2aW9sZW5jZSBpbiBlYWNoIHN0YXRlIHZhcmllZCBvdmVyIHRpbWUsIHRodXMgd2UgYXJlIGludGVyZXN0ZWQgaW4gd2l0aGluIGBTVEFURWB2YXJpYXRpb24sIHNvIHdlIHdpbGwgcGVyZm9ybSBvdXIgcGxtIHdpdGggdGhlIGBtb2RlbCA9IHdpdGhpbmAgYXJndW1lbnQgdG8gcGVyZm9ybSB0aGlzIHBhcnRpY3VsYXIgdHlwZSBvZiBmaXhlZCBlZmZlY3RzIG1vZGVsLiAKCldlIGFsc28gc3BlY3VsYXRlIHRoYXQgdGhlcmUgaXMgYW4gZWZmZWN0IG9mIGluZGl2aWR1YWwgYFNUQVRFYCBpZGVudGl0eSBhbmQgdGltZSBvbiB2aW9sZW50IGNyaW1lIHJhdGUuIEluIG90aGVyd29yZHMsIHdlIGV4cGVjdCBzb21lIHN0YXRlcyB0byBoYXZlIGhpZ2ggcmF0ZXMgb2YgY3JpbWUsIGFuZCBvdGhlcnMgdG8gaGF2ZSBsb3cgcmF0ZXMgb2YgY3JpbWUuIFdlIGFsc28gZXhwZWN0IGNyaW1lIHRvIGNoYW5nZSBvdmVyIHRpbWUuIAoKSWYgd2Ugd2VyZSB0byBwZXJmb3JtIHRoaXMgdHlwZSBvZiBhbmFseXNpcyB3ZSB3b3VsZCB1c2UgdGhlIGBlZmZlY3QgPSAidHdvd2F5cyJgIGFyZ3VtZW50IGluIG91ciBgcGxtKClgIGZ1bmN0aW9uIGxpa2Ugc286CgpgYGB7cn0KRE9OT0hVRV9PVVRQVVQgPC0gcGxtKFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgfgogICAgICAgICAgICAgICAgICAgICAgICBSVENfTEFXICsKICAgICAgICAgICAgICAgICAgICAgICAgV2hpdGVfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBCbGFja19NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIE90aGVyX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgVW5lbXBsb3ltZW50X3JhdGUgKwogICAgICAgICAgICAgICAgICAgICAgICBQb3ZlcnR5X3JhdGUgKyAKICAgICAgICAgICAgICAgICAgICAgICAgUG9wdWxhdGlvbl9sb2cgKyAKICAgICAgICAgICAgICAgICAgICAgICAgcG9saWNlX3Blcl8xMDBrX2xhZywKICAgICAgICAgICAgICAgICAgICAgICAgZWZmZWN0ID0gInR3b3dheXMiLAogICAgICAgICAgICAgICAgICAgICAgICBtb2RlbCA9ICJ3aXRoaW4iLAogICAgICAgICAgICAgICAgICAgICAgICBkYXRhID0gZF9wYW5lbF9ET05PSFVFKQpgYGAKClRvIHNlZSB0aGUgcmVzdWx0cyB3ZSBjYW4gdXNlIHRoZSBiYXNlIGBzdW1tYXJ5KClgIGZ1bmN0aW9uLiBXZSBjYW4gdmlldyB0aGlzIG91dHB1dCBpbiB0aWR5IGZvcm1hdCB1c2luZyB0aGUgYHRpZHkoKWAgZnVuY3Rpb24gb2YgdGhlIGBicm9vbWAgcGFja2FnZS4KCmF2b2NhZG8gSSB0aGluayB0aGUgYGFuYWx5c2lzYCB2YXJpYWJsZSBpcyBhIGxhYmxlIGZvciBwbG90cwoKYGBge3J9CnN1bW1hcnkoRE9OT0hVRV9PVVRQVVQpCgpET05PSFVFX09VVFBVVF9USURZIDwtIHRpZHkoRE9OT0hVRV9PVVRQVVQsIGNvbmYuaW50ID0gMC45NSkKCkRPTk9IVUVfT1VUUFVUX1RJRFkKCkRPTk9IVUVfT1VUUFVUX1RJRFkkQW5hbHlzaXMgPC0gIkFuYWx5c2lzIDEiCmBgYAoKV2Ugd2lsbCBub3cgcGVyZm9ybSBhIHRlc3QgdG8gZGV0ZXJtaW5lIGlmIHdlIGNvdWxkIGhhdmUgc2ltcGx5IHVzZWQgYSBwb29sZWQgbW9kZWwuIFRoaXMgdGVzdCBldmFsdWF0ZXMgaWYgdGhlIGNvZWZmaWNpZW50cyAoaW5jbHVkaW5nIHRoZSBpbnRlcmNlcHRzKSBhcmUgZXF1YWwuICBUbyBwZXJmb3JtIHRoaXMgdGVzdCB3ZSB3aWxsIHVzZSB0aGUgYHBvb2x0ZXN0KClgIGZ1bmN0aW9uIG9mIHRoZSBgcGxtYCBwYWNrYWdlIHRvIGNvbXBhcmUgdGhlIHBvb2xlZCBtb2RlbCB0byB0aGUgZml4ZWQgZWZmZWN0IHdpdGhpbiBtb2RlbC4KCmBgYHtyfQpwb29sdGVzdChWaW9sX2NyaW1lX3JhdGVfMWtfbG9nIH4KICAgICAgICAgICAgICAgICAgICAgICAgUlRDX0xBVyArCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFVuZW1wbG95bWVudF9yYXRlICsKICAgICAgICAgICAgICAgICAgICAgICAgUG92ZXJ0eV9yYXRlICsgCiAgICAgICAgICAgICAgICAgICAgICAgIFBvcHVsYXRpb25fbG9nICsgCiAgICAgICAgICAgICAgICAgICAgICAgIHBvbGljZV9wZXJfMTAwa19sYWcsIAogICAgICAgICBkYXRhID0gZF9wYW5lbF9ET05PSFVFLCAKICAgICAgICAgbW9kZWwgPSAid2l0aGluIikKCmBgYAoKVGhlIGBwLXZhbHVlYCBpcyBsZXNzIHRoYW4gYSBzaWduaWZpY2FuY2UgdGhyZXNob2xkIG9mIC4wNSwgdGh1cyB3ZSByZWplY3QgdGhlIG51bGwgdGhhdCBvdXIgY29lZmZpZW50cyBhcmUgYWxsIGVxdWFsLiBUaHVzIHRoZSBgd2l0aGluYCBmaXhlZCBlZmZlY3RzIG1vZGVsIGZpdCB0aGUgZGF0YSBiZXR0ZXIuCgoKV2UgY2FuIGFsc28gcGVyZm9ybSBhIHRlc3QgdG8gZXZhbHVhdGUgaWYgdGhlcmUgaXMgaW5kZWVkIGFuIGluZGl2aWR1YWwgZWZmZWN0IGFuZCBhIHRpbWUgZWZmZWN0IGluIG91ciBtb2RlbC4KCldlIGNhbiB1c2UgdGhlIGBwbG10ZXN0KClgIGZ1bmN0aW9uIG9mIHRoZSBgcGxtYCBwYWNrYWdlLiBUaGlzIHBlcmZvcm1zIGEgTGFncmFuZ2UgTXVsdGlwbGllciBUZXN0LiBUbyBkbyBzbywgd2UgbmVlZCB0byBnZXQgdGhlIG91dHB1dCBmb3IgYSBzaW1wbGUgcG9vbGVkIG1vZGVsLgoKYGBge3J9CgpET05PSFVFX3Bvb2xfbW9kZWwgPC1wbG0oVmlvbF9jcmltZV9yYXRlXzFrX2xvZyB+CiAgICAgICAgICAgICAgICAgICAgICAgIFJUQ19MQVcgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgV2hpdGVfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBCbGFja19NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIE90aGVyX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBVbmVtcGxveW1lbnRfcmF0ZSArCiAgICAgICAgICAgICAgICAgICAgICAgIFBvdmVydHlfcmF0ZSArIAogICAgICAgICAgICAgICAgICAgICAgICBQb3B1bGF0aW9uX2xvZyArIAogICAgICAgICAgICAgICAgICAgICAgICBwb2xpY2VfcGVyXzEwMGtfbGFnLAogICAgICAgICAgICAgICAgICAgICAgICBtb2RlbCA9ICJwb29saW5nIiwKICAgICAgICAgICAgICAgICAgICAgICAgZGF0YT1kX3BhbmVsX0RPTk9IVUUpCgpwbG10ZXN0KERPTk9IVUVfcG9vbF9tb2RlbCwgZWZmZWN0ID0gYygidHdvd2F5cyIpKQoKYGBgCgpBZ2FpbiwgdGhlIHAtdmFsdWUgaXMgbXVjaCBzbWFsbGVyIHRoYW4gdGhlIHNpZ25pZmljYW5jZSB0aHJlc2hvbGQgb2YgPCAwLjA1LiBUaGVyZWZvcmUgd2UgcmVqZWN0IHRoZSBudWxsIHRoYXQgdGhlcmUgYXJlIG5vIGVmZmVjdHMsIGFuZCB3ZSBjYW4gZmVlbCBjb25maWRlbnQgd2l0aCBwcm9jZWVkaW5nIHdpdGggYSB0d293YXkgZWZmZWN0IG1vZGVsLgoKCgoKClRoZXJlIGlzIG9uZSBtb3JlIHRlc3QgdGhhdCB3ZSBjb3VsZCBwZXJmb3JtLiBUbyB0ZXN0IGlmIHVzaW5nIGEgcmFuZG9tIGVmZmVjdCBtb2RlbCB3b3VsZCBiZSBtb3JlIGFwcHJvcHJpYXRlIGNvbXBhcmVkIHRvIHRoZSBmaXhlZCBlZmZlY3QgbW9kZWwsIG9uZSBjb3VsZCB1c2UgdGhlIFtIYXVzbWVuIHRlc3RdKGh0dHBzOi8vZW4ud2lraXBlZGlhLm9yZy93aWtpL0R1cmJpbiVFMiU4MCU5M1d1JUUyJTgwJTkzSGF1c21hbl90ZXN0KXt0YXJnZXQ9Il9ibGFuayJ9IGZvciB0aGlzIChhbHNvIGNhbGxlZCB0aGUgRHVyYmluLVd1LUhhdXNtYW4gdGVzdCkuIFRoaXMgY2FuIGJlIGltcGxlbWVudGVkIHVzaW5nIHRoZSBgcGh0ZXN0KClgIGZ1bmN0aW9uIG9mIHRoZSBgcGxtYCBwYWNrYWdlLgoKYGBge3J9CgpET05PSFVFX3JhbmRvbV9tb2RlbCA8LSAgcGxtKFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgfgogICAgICAgICAgICAgICAgICAgICAgICBSVENfTEFXICsKICAgICAgICAgICAgICAgICAgICAgICAgV2hpdGVfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBCbGFja19NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIE90aGVyX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgVW5lbXBsb3ltZW50X3JhdGUgKwogICAgICAgICAgICAgICAgICAgICAgICBQb3ZlcnR5X3JhdGUgKyAKICAgICAgICAgICAgICAgICAgICAgICAgUG9wdWxhdGlvbl9sb2cgKyAKICAgICAgICAgICAgICAgICAgICAgICAgcG9saWNlX3Blcl8xMDBrX2xhZywKICAgICAgICAgICAgICAgICAgICAgIGVmZmVjdCA9ICJ0d293YXlzIiwKICAgICAgICAgICAgICAgICAgICAgIG1vZGVsID0gInJhbmRvbSIsCiAgICAgICAgICAgICAgICAgICAgICBkYXRhPWRfcGFuZWxfRE9OT0hVRSkKCkRPTk9IVUVfd2l0aGluX21vZGVsIDwtICBwbG0oVmlvbF9jcmltZV9yYXRlXzFrX2xvZyB+CiAgICAgICAgICAgICAgICAgICAgICAgIFJUQ19MQVcgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgV2hpdGVfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBCbGFja19NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIE90aGVyX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBVbmVtcGxveW1lbnRfcmF0ZSArCiAgICAgICAgICAgICAgICAgICAgICAgIFBvdmVydHlfcmF0ZSArIAogICAgICAgICAgICAgICAgICAgICAgICBQb3B1bGF0aW9uX2xvZyArIAogICAgICAgICAgICAgICAgICAgICAgICBwb2xpY2VfcGVyXzEwMGtfbGFnLAogICAgICAgICAgICAgICAgICAgICAgIGVmZmVjdCA9ICJ0d293YXlzIiwKICAgICAgICAgICAgICAgICAgICAgICBtb2RlbCA9ICJ3aXRoaW4iLAogICAgICAgICAgICAgICAgICAgICAgIGRhdGE9ZF9wYW5lbF9ET05PSFVFKQoKcGh0ZXN0KERPTk9IVUVfd2l0aGluX21vZGVsLCBET05PSFVFX3JhbmRvbV9tb2RlbCkKCmBgYAoKVGhpcyB0ZXN0IGV2YWx1YXRlcyBpZiB0aGVyZSBhcmUgZXJyb3JzICR1X2kkIHRoYXQgYXJlIGNvcnJlbGF0ZWQgd2l0aCBhbnkgb2YgdGhlIGluZGVwZW5kZW50IHZhcmlhYmxlcy4gCgpXZSByZWplY3QgdGhlIG51bGwgaHlwb3RoZXNpcywgdGhhdCB0aGVyZSBhcmUgbm8gaW5jb25zaXN0ZW5jaWVzLCBhbmQgYXJlIGNvbmZpcm1lZCBpbiBvdXIgcGxhbiB0byB1c2VkIGEgZml4ZWQgZWZmZWN0cyBtb2RlbC4KCgoKRm9yIG1vcmUgaW5mb3JtYXRpb24gb24gdGhlc2UgdGVzdHMgYW5kIHRoaXMgcGFja2FnZSwgc2VlIFtoZXJlXShodHRwczovL2NyYW4uci1wcm9qZWN0Lm9yZy93ZWIvcGFja2FnZXMvcGxtL3ZpZ25ldHRlcy9wbG1QYWNrYWdlLmh0bWwpe3RhcmdldD0iX2JsYW5rIn0gIGFuZCBbaGVyZV0oaHR0cDovL3d3dy5wcmluY2V0b24uZWR1L35vdG9ycmVzL1BhbmVsMTAxUi5wZGYpe3RhcmdldD0iX2JsYW5rIn0uCgphdm9jYWRvLSBzdGVwaGFuaWUtIHdoYXQgZG8geW91IHRoaW5rIGFib3V0IHJlZmVyZW5jaW5nIHRoZXNlIHNsaWRlcyBmcm9tIFByaW5jZXRvbj8KCgpBIGZpbmFsIG5vdGUgYWJvdXQgdGhlIGZpeGVkIGFuZCByYW5kb20gZWZmZWN0cyB0ZXJtaW5vbG9neSBhbmQgaG93IHRoaXMgaXMgc2xpZ2h0bHkgZGlmZmVyZW50IHRoYW4gb3RoZXIgZGVmaW5pdGlvbnM6CgpBY2NvcmRpbmcgdG8gdGhlIGRvY3VtZW50YXRpb24gZm9yIHRoZSBbUExNIHBhY2thZ2VdKGh0dHBzOi8vY3Jhbi5yLXByb2plY3Qub3JnL3dlYi9wYWNrYWdlcy9wbG0vdmlnbmV0dGVzL3BsbVBhY2thZ2UuaHRtbCk6Cj5UaGUgZml4ZWQvcmFuZG9tIGVmZmVjdHMgdGVybWlub2xvZ3kgaW4gZWNvbm9tZXRyaWNzIGlzIG9mdGVuIHJlY29nbml6ZWQgdG8gYmUgbWlzbGVhZGluZywgYXMgYm90aCBhcmUgdHJlYXRlZCBhcyByYW5kb20gdmFyaWF0ZXMgaW4gbW9kZXJuIGVjb25vbWV0cmljcyAoc2VlLCBlLmcuLCBXb29sZHJpZGdlICgyMDAyKSAxMC4yLjEpLiBJdCBoYXMgYmVlbiByZWNvZ25pemVkIHNpbmNlIE11bmRsYWvigJlzIGNsYXNzaWMgcGFwZXIgKE11bmRsYWsgKDE5NzgpKSB0aGF0IHRoZSBmdW5kYW1lbnRhbCBpc3N1ZSBpcyB3aGV0aGVyIHRoZSB1bm9ic2VydmVkIGVmZmVjdHMgYXJlIGNvcnJlbGF0ZWQgd2l0aCB0aGUgcmVncmVzc29ycyBvciBub3QuIEluIHRoaXMgbGFzdCBjYXNlLCB0aGV5IGNhbiBzYWZlbHkgYmUgbGVmdCBpbiB0aGUgZXJyb3IgdGVybSwgYW5kIHRoZSBzZXJpYWwgY29ycmVsYXRpb24gdGhleSBpbmR1Y2UgaXMgY2FyZWQgZm9yIGJ5IG1lYW5zIG9mIGFwcHJvcHJpYXRlIEdMUyB0cmFuc2Zvcm1hdGlvbnMuIE9uIHRoZSBjb250cmFyeSwgaW4gdGhlIGNhc2Ugb2YgY29ycmVsYXRpb24sIOKAnGZpeGVkIGVmZmVjdHPigJ0gbWV0aG9kcyBzdWNoIGFzIGxlYXN0IHNxdWFyZXMgZHVtbXkgdmFyaWFibGVzIG9yIHRpbWUtZGVtZWFuaW5nIGFyZSBuZWVkZWQsIHdoaWNoIGV4cGxpY2l0bHksIGFsdGhvdWdoIGluY29uc2lzdGVudGx5MjcsIGVzdGltYXRlIGEgZ3JvdXDigJMgKG9yIHRpbWXigJMpIGludmFyaWFudCBhZGRpdGlvbmFsIHBhcmFtZXRlciBmb3IgZWFjaCBncm91cCAob3IgdGltZSBwZXJpb2QpLgoKPlRodXMsIGZyb20gdGhlIHBvaW50IG9mIHZpZXcgb2YgbW9kZWwgc3BlY2lmaWNhdGlvbiwgaGF2aW5nIGZpeGVkIGVmZmVjdHMgaW4gYW4gZWNvbm9tZXRyaWMgbW9kZWwgaGFzIHRoZSBtZWFuaW5nIG9mIGFsbG93aW5nIHRoZSBpbnRlcmNlcHQgdG8gdmFyeSB3aXRoIGdyb3VwLCBvciB0aW1lLCBvciBib3RoLCB3aGlsZSB0aGUgb3RoZXIgcGFyYW1ldGVycyBhcmUgZ2VuZXJhbGx5IHN0aWxsIGFzc3VtZWQgdG8gYmUgaG9tb2dlbmVvdXMuIEhhdmluZyByYW5kb20gZWZmZWN0cyBtZWFucyBoYXZpbmcgYSBncm91cOKAkyAob3IgdGltZeKAkywgb3IgYm90aCkgc3BlY2lmaWMgY29tcG9uZW50IGluIHRoZSBlcnJvciB0ZXJtLgoKPkluIHRoZSBtaXhlZCBtb2RlbHMgbGl0ZXJhdHVyZSwgb24gdGhlIGNvbnRyYXJ5LCBmaXhlZCBlZmZlY3QgaW5kaWNhdGVzIGEgcGFyYW1ldGVyIHRoYXQgaXMgYXNzdW1lZCBjb25zdGFudCwgd2hpbGUgcmFuZG9tIGVmZmVjdHMgYXJlIHBhcmFtZXRlcnMgdGhhdCB2YXJ5IHJhbmRvbWx5IGFyb3VuZCB6ZXJvIGFjY29yZGluZyB0byBhIGpvaW50IG11bHRpdmFyaWF0ZSBub3JtYWwgZGlzdHJpYnV0aW9uLgoKCiMjIExvdHQgYW5kIE11c3RhcmQKCk9rLCBub3cgd2Ugd2lsbCBkbyB0aGUgc2FtZSBmb3IgdGhlIExvdHQtbGlrZSBhbmFseXNpcy4gSW4gdGhpcyBjYXNlIHdlIHdvdWxkIGhhdmUgYSB2ZXJ5IGxhcmdlIGZvcm11bGEgdG8gd3JpdGUuIFNvIGluc3RlYWQsIHdlIGNhbiB1c2UgdGhlIGBhcy5mb3JtdWxhKClgIGZ1bmN0aW9uIG9mIHRoZSBgc3RhdHNgIHBhY2thZ2UgYW5kIHRoZSBiYXNlIGBwYXN0ZSgpYCBmdW5jdGlvbiB0byBjb21iaW5lIGFsbCBvZiBvdXIgZXhwbGFuYXRvcnkgdmFyaWFibGVzIGludG8gb25lIGZvcm11bGEgd2l0aG91dCBtYWtpbmcgYSBtaXN0YWtlLiBGaXJzdCB3ZSB3aWxsIGNyZWF0ZSBhbiBvYmplY3Qgd2hlcmUgd2Ugc2VsZWN0IG9ubHkgZm9yIHRoZSBleHBsYW5hdG9yeSB2YXJpYWJsZXMuIAoKYXZvY2FkbyBJIHRyaWVkIHVzaW5nIGdsdWUgb3IgZHBseXI6OmNvbGxhcHNlIHRvIG1ha2UgdGhpcyB0aWR5dmVyc2UgYnV0IHRoaXMgZGlkbnQgd29yawoKYGBge3J9CkxPVFRfdmFyaWFibGVzIDwtIExPVFRfREYgJT4lCiAgZHBseXI6OnNlbGVjdChSVENfTEFXLAogICAgICAgICAgICAgICAgY29udGFpbnMoYygiV2hpdGUiLCJCbGFjayIsIk90aGVyIikpLAogICAgICAgICAgICAgICAgVW5lbXBsb3ltZW50X3JhdGUsCiAgICAgICAgICAgICAgICBQb3ZlcnR5X3JhdGUsCiAgICAgICAgICAgICAgICBQb3B1bGF0aW9uX2xvZywKICAgICAgICAgICAgICAgIHBvbGljZV9wZXJfMTAwa19sYWcpICU+JQogIGNvbG5hbWVzKCkKCgpMT1RUX2ZtbGEgPC0gYXMuZm9ybXVsYShwYXN0ZSgiVmlvbF9jcmltZV9yYXRlXzFrX2xvZyB+IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFzdGUoTE9UVF92YXJpYWJsZXMsIGNvbGxhcHNlID0gIiArICIpCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICkKICAgICAgICAgICAgICAgICAgICAgICAgKQoKTE9UVF9mbWxhCgpgYGAKClRoYXQgaXMgcXVpdGUgdGhlIGZvcm11bGEhCgpPaywgbm93IGFnYWluIHdlIHdpbGwgbWFrZSBhIHBhbmVsIGRhdGEgZnJhbWUgYW5kIHdlIHdpbGwgcGVyZm9ybSBmaXQgYSBmaXhlZCBlZmZlY3QgdHdvLXdheSBtb2RlbCBmb3IgdGltZSBhbmQgaW5kaXZpZHVhbHMgKGBTVEFURWApIHdpdGggdGhpcyBkYXRhIGFzIHdlbGwuCgpgYGB7cn0KCmRfcGFuZWxfTE9UVCA8LSBwZGF0YS5mcmFtZShMT1RUX0RGLCBpbmRleD1jKCJTVEFURSIsICJZRUFSIikpCgpMT1RUX09VVFBVVCA8LSBwbG0oTE9UVF9mbWxhLAogICAgICAgICAgICAgICAgICAgICAgbW9kZWwgPSAid2l0aGluIiwKICAgICAgICAgICAgICAgICAgICAgZWZmZWN0ID0gInR3b3dheXMiLAogICAgICAgICAgICAgICAgICAgICAgIGRhdGEgPSBkX3BhbmVsX0xPVFQpCgpzdW1tYXJ5KExPVFRfT1VUUFVUKQoKTE9UVF9PVVRQVVRfVElEWSA8LSB0aWR5KExPVFRfT1VUUFVULCBjb25mLmludCA9IDAuOTUpCgpMT1RUX09VVFBVVF9USURZJEFuYWx5c2lzIDwtICJBbmFseXNpcyAyIgpgYGAKCgojIyBSVEMgY29lZmZpY2llbnQgY29tcGFyaXNvbgoKTm93IGxldCdzIG1ha2UgYSBwbG90IHRvIGNvbXBhcmUgdGhlIGNvZWZmZWNpZW50IGVzdGltYXRlIGZvciB0aGUgUmlnaHQtdG8tY2FycnkgbGF3IGFkb3B0aW9uIHZhcmlhYmxlIGluIGVhY2ggbW9kZWwuCgpGaXJzdCB3ZSB3aWxsIGNvbWJpbmUgbW9kZWwgZml0IGluZm9ybWF0aW9uIGZvciB0aGlzIGNvZWZmaWNpZW50IGZvciBlYWNoIG1vZGVsLgoKYGBge3J9CmNvbXBhcmluZ19hbmFseXNlcyA8LSBET05PSFVFX09VVFBVVF9USURZICU+JQogIGJpbmRfcm93cyhMT1RUX09VVFBVVF9USURZKSAlPiUKICBmaWx0ZXIodGVybSA9PSAiUlRDX0xBV1RSVUUiKQoKY29tcGFyaW5nX2FuYWx5c2VzCmBgYAoKV2UgY2FuIHNlZSB0aGF0IGZvciB0aGUgZmlyc3QgYW5hbHlzaXMgKHNpbWlsYXIgdG8gdGhlIFtEb25vaHVlIGV0IGFsLl0oaHR0cHM6Ly93d3cubmJlci5vcmcvcGFwZXJzL3cyMzUxMC5wZGYpIHt0YXJnZXQ9Il9ibGFuayJ9IHN0dWR5KSB0aGUgY29lZmZpY2llbnQgZXN0aW1hdGUgZm9yIHRoZSBwcmVzZW5jZSBvZiBhIHBlcm1pc3NpdmUgUmlnaHQtdG8tY2FycnkgbGF3IGlzIHBvc2l0aXZlLCB3aGlsZSBmb3IgdGhlIHNlY29uZCBhbmFseXNpcyAoc2ltaWxhciB0byB0aGUgW0xvdHQgYW5kIE11c3RhcmRdKGh0dHBzOi8vY2hpY2Fnb3VuYm91bmQudWNoaWNhZ28uZWR1L2NnaS92aWV3Y29udGVudC5jZ2k/YXJ0aWNsZT0xMTUwJmNvbnRleHQ9bGF3X2FuZF9lY29ub21pY3Mpe3RhcmdldD0iX2JsYW5rIn0gc3R1ZHkpIHRoZSBjb2VmZmljaWVudCBlc3RpbWF0ZSBpcyBuZWdhdGl2ZS4gVGh1cyBpbiB0aGUgZmlyc3QgYW5hbHlzaSB3ZSBjb3VsZCBjb25jbHVkZSB0aGF0IHRoZSBlZmZlY3Qgb2YgYWRvcHRpbmcgcGVybWlzc2l2ZSByaWdodC10by1jYXJyeSBsYXdzICBtYXkgYmUgYXNzb2NpYXRlZCB3aXRoIGluY3JlYXNlcyBpbiB2aW9sZW50IGNyaW1lIChhbHRob3VnaCB0aGlzIHdhcyBub3QgYSBzaWduaWZpY2FudCByZXN1bHQgKGluIGNvbnRyYXN0IHdpdGggdGhlIHJlYWwgW0Rvbm9odWUgZXQgYWwuXShodHRwczovL3d3dy5uYmVyLm9yZy9wYXBlcnMvdzIzNTEwLnBkZikge3RhcmdldD0iX2JsYW5rIn0gc3R1ZHkgKSk7IHdoaWxlIGluIHRoZSBvdGhlciBhbmFseXNpcyB3ZSBjb3VsZCBjb25jbHVkZSB0aGF0IHRoZSBsYXdzIG1heSBiZSBhc3NvY2lhdGVkIHdpdGggZGVjcmVhc2VzIGluIHZpb2xlbnQgY3JpbWUuCgpMZXQncyBtYWtlIGEgcGxvdCBvZiB0aGlzIGZpbmRpbmcuIFdlIHdpbGwgc2hvdyBlcnJvcmJhcnMgZm9yIHRoZSBjb2VmZmljaWVudCBlc3RpbWF0ZXMgZm9yIGJvdGggYW5hbHlzZXMgdXNpbmcgdGhlIGBnZW9tX2Vycm9yYmFyKClgIGZ1bmN0aW9uIG9mIHRoZSBgZ2dwbG90MmAgcGFja2FnZS4gVGhpcyByZXF1aXJlcyBzcGVjaWZ5aW5nIHRoZSBtaW5pbXVtIGFuZCBtYXhpbXVtIGZvciBvdXIgZXJyb3JiYXIsIHdoaWNoIGluIG91ciBjYXNlIHdlIHdvdWxkIGxpa2UgdG8gYmUgdGhlIGxvdyBhbmQgaGlnaCB2YWx1ZXMgb2Ygb3VyIGNvbmZpZGVuY2UgaW50ZXJ2YWxzIGZvciB0aGUgY29lZmZpY2llbnQgZXN0aW1hdGVzLiBXZSB3aWxsIGFsc28gYWRkIGEgaG9yaXpvbnRhbCBsaW5lIGF0IHkgPSAwIHVzaW5nIHRoZSBgZ2VvbV9obGluZSgpYCBmdW5jdGlvbiBvZiB0aGUgYGdncGxvdDJgIHBhY2thZ2UuIAoKRmluYWxseSB3ZSB3aWxsIGFkZCBhcnJvd3MgdG8gZW1waGFzaXplIHRoZSBkaWZmZXJlbmNlIGluIHRoZSBkaXJlY3Rpb24gb2YgdGhlIGZpbmRpbmdzIHVzaW5nIHRoZSBgZ2VvbV9zZWdtZW50KClgIGZ1bmN0aW9uIG9mIHRoZSBgZ2dwbG90MmAgcGFja2FnZS4gVXNpbmcgdGhlIGBhcnJvdygpYCBmdW5jdGlvbiwgd2UgY2FuIHNwZWNpZnkgZGV0aWFscyBhYm91dCB0aGUgYXJyb3cgd2Ugd291bGQgbGlrZSB0byBhZGQuCgpgYGB7cn0KI2xpYnJhcnkoZ3JpZCkKCmNvbXBhcmluZ19hbmFseXNlc19wbG90IDwtIGdncGxvdChjb21wYXJpbmdfYW5hbHlzZXMpICsgCiAgZ2VvbV9wb2ludChhZXMoeCA9IEFuYWx5c2lzLCB5ID0gZXN0aW1hdGUpKSArCiAgZ2VvbV9lcnJvcmJhcihhZXMoeCA9IEFuYWx5c2lzLCB5bWluID0gY29uZi5sb3csIHltYXggPSBjb25mLmhpZ2gpLCB3aWR0aCA9IDAuMjUpICsgCiAgZ2VvbV9obGluZSh5aW50ZXJjZXB0ID0gMCwgY29sb3IgPSAicmVkIikgKwogIHNjYWxlX3lfY29udGludW91cyhicmVha3MgPSBzZXEoLTAuMiwgMC4yLCBieSA9IDAuMDUpLAogICAgICAgICAgICAgICAgICAgICBsYWJlbHMgPSBzZXEoLTAuMiwgMC4yLCBieSA9IDAuMDUpLAogICAgICAgICAgICAgICAgICAgICBsaW1pdHMgPSBjKC0wLjIsMC4yKSkgKwogIGdlb21fc2VnbWVudChhZXMoeCA9IDEsIHkgPSAwLjEyNSwgeGVuZCA9IDEsIHllbmQgPSAwLjE3NSksCiAgICAgICAgICAgICAgIGFycm93ID0gYXJyb3coYW5nbGUgPSA0NSwgZW5kcyA9ICJsYXN0IiwgdHlwZSA9ICJvcGVuIiksCiAgICAgICAgICAgICAgIHNpemUgPSAyLAogICAgICAgICAgICAgICBjb2xvciA9ICJncmVlbiIsCiAgICAgICAgICAgICAgIGxpbmVlbmQgPSAiYnV0dCIsCiAgICAgICAgICAgICAgIGxpbmVqb2luID0gIm1pdHJlIikgKwogIGdlb21fc2VnbWVudChhZXMoeCA9IDIsIHkgPSAtMC4xMjUsIHhlbmQgPSAyLCB5ZW5kID0gLTAuMTc1KSwKICAgICAgICAgICAgICAgYXJyb3cgPSBhcnJvdyhhbmdsZSA9IDQ1LCBlbmRzID0gImxhc3QiLCB0eXBlID0gIm9wZW4iKSwKICAgICAgICAgICAgICAgc2l6ZSA9IDIsCiAgICAgICAgICAgICAgIGNvbG9yID0gInJlZCIsCiAgICAgICAgICAgICAgIGxpbmVlbmQgPSAiYnV0dCIsCiAgICAgICAgICAgICAgIGxpbmVqb2luID0gIm1pdHJlIikgKwogIHRoZW1lX21pbmltYWwoKSArIAogIHRoZW1lKGF4aXMudGl0bGUueCA9IGVsZW1lbnRfYmxhbmsoKSwKICAgICAgICBheGlzLnRleHQgPSBlbGVtZW50X3RleHQoc2l6ZSA9IDEyKSkgKwogIGxhYnModGl0bGUgPSAiRWZmZWN0IGVzdGltYXRlIG9uIGxuKHZpb2xlbnQgY3JpbWVzIHBlciAxMDAsMDAwIHBlb3BsZSkiLAogICAgICAgeSA9ICJFZmZlY3QgZXN0aW1hdGUgKDk1JSBDSSkiKQoKY29tcGFyaW5nX2FuYWx5c2VzX3Bsb3QKYGBgCgpXZSBjYW4gc2VlIHRoYXQgbW9zdCBvZiB0aGUgcG9zc2libGUgcmFuZ2Ugb2YgdmFsdWVzIGZvciB0aGUgZXN0aW1hdGUgaW4gYW5hbHlzaXMgMSBhcmUgcG9zaXRpdmUsIHdoaWxlIHRoZXkgYXJlIGFsbCBuZWdhdGl2ZSBmb3IgYW5hbHlzaXMgMi4KCiMgTXVsdGljb2xsaW5lYXJpdHkgYW5hbHlzaXMKCkhvdyBkaWQgdGhlIGFib3ZlIGhhcHBlbj8KClRoZSBhbmFseXNpcyBkYXRhZnJhbWVzIGFyZSB2ZXJ5IHNpbWlsYXIgeWV0IHJlbmRlcmVkIHZlcnkgZGlmZmVyZW50IHJlc3VsdHMuIAoKUmVjYWxsIHRoYXQgdGhlIG9ubHkgZGlmZmVyZW5jZSBpcyB0aGUgbnVtYmVyIG9mIGRlbW9ncmFwaGljIHZhcmlhYmxlcy4gVGhlIG51bWJlciBvZiByb3dzIG9yIG9ic2VydmF0aW9ucyBpcyB0aGUgc2FtZS4gV2UgY2FuIHVzZSB0aGUgYGFsbF9lcXVhbCgpYCBmdW5jdGlvbiBvZiB0aGUgYGRwbHlyYCBwYWNrYWdlIHRvIGNvbXBhcmUgdGhlIG51bWJlciBvZiBjb2x1bW5zIG9mIG91ciBEb25vaHVlLWxpa2UgZGF0YSBhbmQgb3VyIExvdHQtbGlrZSBkYXRhLgoKYGBge3J9CmFsbF9lcXVhbCh0YXJnZXQgPSBET05PSFVFX0RGLAogICAgICAgICAgY3VycmVudCA9IExPVFRfREYsCiAgICAgICAgICBpZ25vcmVfY29sX29yZGVyID0gVFJVRSwKICAgICAgICAgIGlnbm9yZV9yb3dfb3JkZXIgPSBUUlVFKQpgYGAKClVzaW5nIHRoZSBiYXNlIGBkaW0oKWAgZnVuY3Rpb24gd2UgY2FuIGFsc28gbG9vayBhdCB0aGUgbnVtYmVyIG9mIHJvd3MgZm9yIGVhY2ggYW5kIHNlZSB0aGF0IHRoZSBudW1iZXIgb2Ygb2JzZXJ2YXRpb3NuIGlzIHRoZSBzYW1lIGZvciBib3RoIGRhdGFzZXRzLgoKYGBge3J9CmRpbShET05PSFVFX0RGKVsxXQpkaW0oTE9UVF9ERilbMV0KYGBgCgpUaGUgb25seSBkaWZmZXJlbmNlIGJldHdlZW4gdGhlIHR3byBkYXRhZnJhbWVzIHJlc3RzIGluIGhvdyB0aGUgZGVtb2dyYXBoaWMgdmFyaWFibGVzIHdlcmUgcGFyYW1ldGVyaXplZC4KCmBgYHtyfQpET05PSFVFX0RGICU+JQogIGRwbHlyOjpzZWxlY3QoY29udGFpbnMoInllYXJzIikpICU+JQogIGNvbG5hbWVzKCkKCkxPVFRfREYgJT4lCiAgZHBseXI6OnNlbGVjdChjb250YWlucygieWVhcnMiKSkgJT4lCiAgY29sbmFtZXMoKQpgYGAKCkNsZWFybHksIHRoaXMgaGFkIGFuIGVmZmVjdCBvbiB0aGUgcmVzdWx0cyBvZiB0aGUgYW5hbHlzaXMuIAoKTGV0J3MgZXhwbG9yZSBob3cgdGhpcyBvY2N1cmVkLiAKCldoZW4gc2VlbWluZ2x5IGluZGVwZW5kZW50IHZhcmlhYmxlcyBhcmUgaGlnaGx5IHJlbGF0ZWQgdG8gb25lIGFub3RoZXIsIHRoZSByZWxhdGlvbnNoaXBzIGVzdGltYXRlZCBpbiBhbiBhbmFseXNpcyBtYXkgYmUgZGlzdG9ydGVkLiAKCkluIHJlZ3Jlc3Npb24gYW5hbHlzaXMsIHRoaXMgZGlzdG9ydGlvbiBpcyBvZnRlbiBhIGJ5LXByb2R1Y3Qgb2YgYSB2aW9sYXRpb24gb2YgdGhlIGluZGVwZW5kZW5jZSBhc3N1bXB0aW9uLiBUaGlzIGRpc3RvcnRpb24sIGlmIGxhcmdlIGVub3VnaCwgY2FuIGltcGFjdCBzdGF0aXN0aWNhbCBpbmZlcmVuY2UuIAoKVGhlIHBoZW5vbW9uYSBjYWxsZWQgbXVsdGljb2xsaW5lYXJpdHkgb2NjdXJzIHdoZW4gaW5kZXBlbmRlbnQgdmFyaWFibGVzIGFyZSBoaWdobHkgcmVsYXRlZCB0byBvbmUgYW5vdGhlcgoKVGhlcmUgYXJlIHNldmVyYWwgd2F5cyB3ZSBjYW4gZGlhZ25vc2UgbXVsdGljb2xsaW5lYXJpdHkuCgojIyMgQ29ycmVsYXRpb24KCk9uZSB3YXkgd2UgY2FuIGV2YWx1YXRlIHRoZSByZWxhdGlvbnNoaXBzIGJldHdlZW4gdmFyaWFibGVzIGlzIGJ5IGV4YW1pbmluZyB0aGUgY29ycmVsYXRpb24gYmV0d2VlbiB2YXJpYWJsZSBwYWlycy4KCjxzdHlsZT4KZGl2LmJsdWUgeyBiYWNrZ3JvdW5kLWNvbG9yOiNlNmYwZmY7IGJvcmRlci1yYWRpdXM6IDVweDsgcGFkZGluZzogMjBweDt9Cjwvc3R5bGU+CjxkaXYgY2xhc3MgPSAiYmx1ZSI+CgpJdCBpcyBpbXBvcnRhbnQgdG8gbm90ZSB0aGF0IG11bHRpY29sbGluZWFyaXR5IGFuZCBjb3JyZWxhdGlvbiBhcmUgbm90IG9uZSBhbmQgdGhlIHNhbWUuIENvcnJlbGF0aW9uIGNhbiBiZSB0aG91Z2h0IG9mIGFzIHRoZSBzdHJlbmd0aCBvZiB0aGUgcmVsYXRpb25zaGlwIGJldHdlZW4gdmFyaWFibGVzLiBPbiB0aGUgb3RoZXIgaGFuZCwgbXVsdGljb2xsaW5lYXJpdHkgY2FuIGJlIHRob3VnaHQgb2YgYXMgdGhlIHRoZSB2aW9sYXRpb24gb2YgdGhlIGluZGVwZW5kZW5jZSBhc3N1bXB0aW9uIHRoYXQgaXMgYSBjb25zZXF1ZW5jZSBvZiB0aGlzIGNvcnJlbGF0aW9uIGluIGEgcmVncmVzc2lvbiBhbmFseXNpcy4gCgo8L2Rpdj4KCgoKCiMjIyMgU2NhdHRlcnBsb3RzCgpPbmUgd2F5IHRvIGxvb2sgYXQgY29ycmVsYXRpbiBhY3Jvc3MgcGFpcnMgb2YgdmFyaWFibGVzIGlzIHRvIHVzZSB0aGUgYGdncGFpcnMoKWAgZnVuY3Rpb24gb2YgdGhlIGBHR2FsbHlgIHBhY2thZ2UuCgpgYGB7cn0KY29sbmFtZXMoRE9OT0hVRV9ERikKCkRPTk9IVUVfREYgJT4lIAogIGRwbHlyOjpzZWxlY3QoUlRDX0xBVywKICAgICAgICAgICAgICAgIFZpb2xfY3JpbWVfcmF0ZV8xa19sb2csCiAgICAgICAgICAgICAgICBVbmVtcGxveW1lbnRfcmF0ZSwKICAgICAgICAgICAgICAgIFBvdmVydHlfcmF0ZSwKICAgICAgICAgICAgICAgIFBvcHVsYXRpb25fbG9nKSAlPiUgCiAgZ2dwYWlycyguLAogICAgICAgICAgY29sdW1ucyA9IGMoMjo1KSwKICAgICAgICAgIGxvd2VyID0gbGlzdChjb250aW51b3VzID0gd3JhcCgic21vb3RoX2xvZXNzIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb2xvciA9ICJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGFscGhhID0gMC41LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHNpemUgPSAwLjEpKSkKYGBgCldlIGNhbiBzZWUgdGhhdCBmb3IgdGhlIG5vbi1kZW1vZ3JhcGhpYyB2YXJpYWJsZXMsIHRoZXJlIGlzIHZlcnkgbGl0dGxlIGNvcnJlbGF0aW9uIGJldHdlZW4gdGhlIHBhaXJzIG9mIHZhcmlhYmxlcy4gT25seSB0aGUgdW5lbXBsb3ltZW50IHJhdGUgYW5kIHRoZSBwb3ZlcnR5IHJhdGUgc2hvdyByZWxhdGl2ZWx5IHN0cm9uZyBjb3JyZWxhdGlvbiwgYXMgb25lIG1pZ2h0IGV4cGVjdC4gCgoKIyMjIyBIZWF0bWFwcwoKQW5vdGhlciB3YXkgdG8gbG9vayBhdCBjb3JyZWxhdGlvbiBpZiB3ZSBoYXZlIG1hbnkgdmFyaWFibGVzIGlzIHRvIHVzZSBoZWF0bWFwcy4KCkxldCdzIHRvIHRoaXMgbm93IGZvciB0aGUgZGVvbW9ncmFwaGljIHZhcmlhYmxlcyBmb3IgZWFjaCBhbmFseXNpcy4KClRoZSBgZ2djb3JycGxvdCgpYCBmdW5jdGlvbiBvZiB0aGUgYGdncGNvcnBsb3RgIHBhY2thZ2UgaXMgb25lIHdheSB0byBjcmVhdGUgc3VjaCBhIGhlYXRtYXAuCgpUaGlzIHJlcXVpcmVzIGZpcnN0IGNhbGN1bGF0aW5nIHRoZSBjb3JyZWFsdGlvbiB2YWx1ZXMgdXNpbmcgdGhlIGBjb3IoKWAgZnVuY3Rpb24gb2YgdGhlIGBzdGF0c2AgcGFja2FnZS4KCmBgYHtyfQpjb3JfRE9OT0hVRV9kZW0gPC0gY29yKERPTk9IVUVfREYgJT4lIGRwbHlyOjpzZWxlY3QoY29udGFpbnMoIl95ZWFycyIpKSkKCmNvcnJfbWF0X0RPTk9IVUUgPC0gZ2djb3JycGxvdChjb3JfRE9OT0hVRV9kZW0sCiAgICAgICAgICAgdGwuY2V4ID0gNiwKICAgICAgICAgICBoYy5vcmRlciA9IFRSVUUsCiAgICAgICAgICAgY29sb3JzID0gYygicmVkIiwKICAgICAgICAgICAgICAgICAgICAgICJ3aGl0ZSIsCiAgICAgICAgICAgICAgICAgICAgICAicmVkIiksCiAgICAgICAgICAgb3V0bGluZS5jb2xvciA9ICJ0cmFuc3BhcmVudCIsCiAgICAgICAgICAgdGl0bGUgPSAiQ29ycmVsYXRpb24gTWF0cml4LCBBbmFseXNpcyAxIiwKICAgICAgICAgICBsZWdlbmQudGl0bGUgPSBUZVgoIiRcXHJobyQiKSkKCmNvcnJfbWF0X0RPTk9IVUUKCmNvcl9MT1RUX2RlbSA8LSBjb3IoTE9UVF9ERiAlPiUgZHBseXI6OnNlbGVjdChjb250YWlucygiX3llYXJzIikpKQoKY29ycl9tYXRfTE9UVCA8LSBnZ2NvcnJwbG90KGNvcl9MT1RUX2RlbSwKICAgICAgICAgICB0bC5jZXggPSA2LAogICAgICAgICAgIGhjLm9yZGVyID0gVFJVRSwKICAgICAgICAgICBjb2xvcnMgPSBjKCJyZWQiLAogICAgICAgICAgICAgICAgICAgICAgIndoaXRlIiwKICAgICAgICAgICAgICAgICAgICAgICJyZWQiKSwKICAgICAgICAgICBvdXRsaW5lLmNvbG9yID0gInRyYW5zcGFyZW50IiwKICAgICAgICAgICB0aXRsZSA9ICJDb3JyZWxhdGlvbiBNYXRyaXgsIEFuYWx5c2lzIDIiLAogICAgICAgICAgIGxlZ2VuZC50aXRsZSA9IFRlWCgiJFxccmhvJCIpKQoKY29ycl9tYXRfTE9UVApgYGAKV2UgY2FuIHNlZSB0aGF0IG1hbnkgb2YgdGhlIGRlbW9ncmFwaGljIHZhcmlhYmxlcyBhcmUgaGlnaGx5IGNvcnJlbGF0ZWQgd2l0aCBvbmUgYW5vdGhlci4gCgoKVGhlIHByZXNlbmNlIG9mIGNvcnJlbGF0aW9uIGJld3RlZW4gdmFyaWFibGVzIHN1Z2dlc3RzIHRoYXQgd2UgbWlnaHQgaGF2ZSBtdWx0aWNvbGxpbmVhcml0eS4gSG93ZXZlciBpdCBkb2VzIG5vdCBuZWNlc3NhcmlseSBtZWFuIHRoYXQgd2UgZG8uIFNvIGhvdyBjYW4gd2UgYXNzZXNzIHRoaXM/CgoKIyMjIENvZWZmaWNpZW50IGVzdGltYXRlIGluc3RhYmlsaXR5CgpPbmUgd2F5IHRvIGxvb2sgYXQgdGhlIHBvc3NpYmxlIGluZmx1ZW5jZSBvZiBtdWx0aWNvbGxpbmVhcml0IGlzIHRvIGxvb2sgYXQgdGhlIHN0YWJpbGl0eSBvZiB0aGUgY29lZmZpY2llbnQgZXN0aW1hdGVzLgoKV2Ugd2lsbCBmb2N1cyBvbiB0aGUgYFJUQ19MQVdgIHZhcmlhYmxlIGNvZWZmaWNpZW50IGVzdGltYXRlLCBhcyB0aGlzIGlzIG9mIHBhcnRpY3VsYXIgaW50ZXJlc3QgaW4gb3VyIGNhc2UuCgpUbyBkbyBzbyB3ZSB3aWxsIHBlcmZvcm0gbXVsdGlwbGUgaXRlcmF0aW9ucyBvZiBvdXIgYW5hbHlzaXMsIGJ1dCB3ZSB3aWxsIHJlbW92ZSBvbmUgb2JzZXJ2YXRpb24gYW5kIHNlZSBpZiB0aGF0IGNoYW5nZXMgb3VyIGNvZWZmaWNpZW50IGVzdGltYXRlIHJlc3VsdHMuICAgCgoKVG8gZG8gdGhpcyB3ZSB3aWxsIHVzZSBzb21lIGZ1bmN0aW9ucyBpbiB0aGUgYHJzYW1wbGVgIHBhY2thZ2Ugd2hpY2ggaXMgdmVyeSB1c2VmdWwgZm9yIHNwbGl0dGluZyBkYXRhIGluIHZhcmlvdXMgd2F5cy4KCldlIHdpbGwgdXNlIHRoZSBgbG9vX2N2KClgIGZ1bmN0aW9uIHdoaWNoIHN0YW5kcyBmb3IgbGVhdmUgb25lIG91dCBjcm9zcyB2YWxpZGF0aW9uLiBUaGlzIHdpbGwgYWxsb3cgdXMgdG8gc3BsaXQgb3VyIGRhdGEgaW50byBldmVyeSBwb3NzaWJsZSBzdWJzZXQgd2hlcmUgYSB1bmlxdWUgb2JzZXJ2YXRpb24gaXMgbGVmdCBvdXQgb2YgdGhlIGRhdGEuCgpUaGlzIGZ1bmN0aW9uIHdpbGwgaG93ZXZlciBvbmx5IHByZXBhcmUgdGhlIGRhdGEgdG8gYmUgc3BsaXQuCgpUbyBhY3R1YWxseSBnZXQgdGhlIHJlbWFpbmluZyBkYXRhIGFmdGVyIHRoZSByZW1vdmFsIG9mIHRoZSBvYnNlcnZhdGlvbiB0aGF0IGlzIGxlZnQgb3V0IHdoZW4gbmVlZCB0byB1c2UgYSBmdW5jdGlvbiBjYWxsZWQgYHRyYWluaW5nKClgLiBUaGlzIGlzIGJlY2F1c2UgdGhlc2UgZnVuY3Rpb25zIGFyZSBvZnRlbiB1c2VkIGZvciBpbiBtYWNoaW5lIGxlYXJuaW5nIGFwcGxpY2F0aW9ucyB3aGVyZSB0aGUgZGF0YSBpcyBzcGxpdCBiZXR3ZWVuIGEgbGFyZ2VyIHRyYWluaW5nIHNldCBhbmQgYSBzbWFsbGVyIHRlc3Rpbmcgc2V0LiBUaHVzIHdlIHdhbnQgdGhlIGxhcmdlciAkbi0xJCBzdWJzZXQsIGFzIG9wcG9zZWQgdG8gdGhlIHNpbmdsZSB2YWx1ZSB0aGF0IGlzIHJlbW92ZWQsICh3aGljaCB3ZSBjb3VsZCBnZXQgd2l0aCB0aGUgYHRlc3RpbmcoKWAgZnVuY3Rpb24pCgphdm9jYWRvIG1vdmUgdGhpczpOb3RlIHRoYXQgdGhpcyBjYXVzZXMgb3VyIGRhdGEgdG8gYmUgYW4gdW5iYWxhbmNlZCBwYW5lbC4KVGhpcyBkb2VzIG5vdCByZXF1aXJlIGFueSBhZGp1c3RtZW50IHRvIHRoZSBjb2RlIHRvIG1vZGVsIHRoZSBkYXRhLCBidXQgeW91IHdpbGwgbm90aWNlIHRoYXQgdGhlIG91dHB1dCB3aWxsIG5vdyBzYXkgInVuYmFsYW5jZWQiLgoKCjxkZXRhaWxzPiA8c3VtbWFyeT4gQ2xpY2sgaGVyZSB0byBzZWUgYW4gZXhhbXBsZSBvZiBob3cgdGhpcyB3b3Jrcy4gPC9zdW1tYXJ5PgoKRmlyc3Qgd2Ugd2lsbCBtYWtlIGEgdG95IGRhdGFzZXQgdGhhdCBpcyB2ZXJ5IHNpbWxlIGNhbGxlZCB0ZXN0IHVzaW5nIHRoZSBgdGliYmxlKClgIGZ1bmN0aW9uIG9mIHRoZSBgdGlkeXJgIHBhY2thZ2U6CmBgYHtyfQp0ZXN0IDwtdGlkeXI6OnRpYmJsZSh4ID0gYygxLDIsMykpCnRlc3QKYGBgCgpOb3cgd2Ugd2lsbCB1c2UgdGhlIGBsb29fY3YoKWAgdG8gY3JlYXRlIGxlYXZlIG9uZSBvdXQgc3BsaXRzOgpgYGB7cn0KdGVzdF9zYW1wbGVzIDwtIHRlc3QgJT4lIGxvb19jdigpCnRlc3Rfc2FtcGxlcwpgYGAKCldlIGNhbiB0YWtlIGEgbG9vayBhdCBvbmUgaW5kaXZpZHVhbCBzcGxpdCB1c2luZyB0aGUgYHB1bGwoKWAgZnVuY3Rpb246CgpgYGB7cn0KcHVsbCh0ZXN0X3NhbXBsZXMsIHNwbGl0cykKYGBgCgpIZXJlIHlvdSBjYW4gc2VlIHRoYXQgMiB2YWx1ZXMgYXJlIGludGVuZGVkIGZvciB0aGUgdHJhaW5pbmcgc2V0IChhc2xvIGNhbGxlZCBBbmFseXNpcyBzZXQpLCAxIHZhbHVlIGlzIGludGVuZGVkIGZvciB0aGUgdGVzdGluZyBzZXQgKGFsc28gY2FsbGVkIEFzc2Vzc21lbnQgc2V0KSwgYW5kIDMgdmFsdWVzIHdlcmUgcHJlc2VudCBpbml0aWFsbHkuCgpOb3cgd2Ugd2lsbCB1c2UgdGhlIGB0cmFpbmluZygpYCBmdW5jdGlvbiB0byBnZXQgdGhlIGRhdGEgd2l0aG91dCB0aGUgb2JlcnN2YXRpb24gdGhhdCBpcyBzZXQgYXNpZGUuIEhlcmUgaXMgdGhlIGRhdGEgZm9yIHRoZSBmaXJzdCBzdWJzZXQ6CmBgYHtyfQp0cmFpbmluZyhwdWxsKHRlc3Rfc2FtcGxlcywgc3BsaXRzKVtbMV1dKQpgYGAKCk5vdyB3ZSB3aWxsIHVzZSB0aGUgYG1hcCgpYCBmdW5jdGlvbiBvZiBgcHVycnJgIHRvIGdldCBhbGwgcG9zc2libGUgYHRyYWluaW5nYCBzdWJzZXQgb2YgdGhlIGRhdGEuCmBgYHtyfQoKdGVzdF9zdWJzZXRzIDwtIG1hcChwdWxsKHRlc3Rfc2FtcGxlcywgc3BsaXRzKSwgdHJhaW5pbmcpCnRlc3Rfc3Vic2V0cwpgYGAKCldlIGNhbiBzZWUgdGhhdCB0aGVyZSBhcmUgMyBwb3NzaWJsZSBzdWJzZXRzIHRoYXQgbGVhdmUgb25lIHZhbHVlIG91dC4gQWxsIDMgcG9zc2libGUgc3Vic2V0cyBhcmUgY3JlYXRlZCB1c2luZyB0aGlzIG1ldGhvZC4gVGhpcyBtZXRob2Qgd2lsbCBhbHdheXMgY3JlYXRlIHRoZSBzYW1lIG51bWJlciBvZiBzdWJzZXRzIGFzIHRoZXJlIGFyZSB1bnFpdWUgdmFsdWVzIG9yIHJvd3MgaW4gdGhlIGRhdGEuCgo8L2RldGFpbHM+CgoKTm93IHdlIHdpbGwgdXNlIHRoaXMgbWV0aG9kIHdpdGggdGhlIGRhdGEgZnJvbSBvdXIgRG9ub2h1ZS1saWtlIGFuYWx5c2lzLCBzaW5jZSB0aGlzIGRhdGEgaGFzIGBkaW0oZF9wYW5lbF9ET05PSFVFKVsxXWAgcm93cywgYGRpbShkX3BhbmVsX0RPTk9IVUUpWzFdYCBzdWJzZXRzIHdpbGwgYmUgY3JlYXRlZCB0aGF0IGxlYXZlIG91dCBvbmUgcm93LgoKRmlyc3Qgd2Ugd2lsbCBjcmVhdGUgdGhlIHNwbGl0cyB1c2luZyB0aGUgYGxvb19jdigpYCBmdW5jdGlvbjoKYGBge3J9CnNldC5zZWVkKDEyNCkKRE9OT0hVRV9zcGxpdHMgPC0gZF9wYW5lbF9ET05PSFVFICU+JSBsb29fY3YoKQpET05PSFVFX3NwbGl0cwpgYGAKCk5vdyB3ZSB3aWxsIHVzZSB0aGUgYHRyYWluaW5nKClgIGZ1bmN0aW9uIHRvIHNlbGVjdCB0aGUgcmVtYWluaW5nIGRhdGEgd2l0aG91dCB0aGUgdmFsdWUgdGhhdCB3YXMgcmVtb3ZlZCBmb3IgZWFjaCBzcGxpdDoKCmBgYHtyfQojIFRvIGdldCBhbGwgdGhlIGRhdGEgc3Vic2V0cwpET05PSFVFX3N1YnNldHMgPC1tYXAocHVsbChET05PSFVFX3NwbGl0cywgc3BsaXRzKSwgdHJhaW5pbmcpCgpnbGltcHNlKERPTk9IVUVfc3Vic2V0c1tbMV1dKQpsZW5ndGgoRE9OT0hVRV9zdWJzZXRzKQpgYGAKCkFzIGV4cGVjdGVkIHRoZSBmaXJzdCBzdWJzZXQgaGFzIDEsMzk0IHJvd3MgYW5kIHRoZXJlIGFyZSAxMzk1IHN1YnNldHMuCgpMZXQncyBzZWUgd2hhdCBvYnNldmF0aW9uIHdhcyBsZWZ0IG91dCBpbiB0aGUgZmlyc3Qgc3Vic2V0OgoKYGBge3J9CmRfcGFuZWxfRE9OT0hVRSAlPiUKICBmaWx0ZXIoISByb3duYW1lcyhkX3BhbmVsX0RPTk9IVUUpICAlaW4lIHJvd25hbWVzKERPTk9IVUVfc3Vic2V0c1tbMV1dKSkKCiMgQW5vdGhlciB3YXkgdG8gY2hlY2sgaXMgdG8gdXNlOgpET05PSFVFX3JlbW92ZWQgPC1tYXAocHVsbChET05PSFVFX3NwbGl0cywgc3BsaXRzKSwgdGVzdGluZykKCkRPTk9IVUVfcmVtb3ZlZFtbMV1dCmBgYAoKSXQgbG9va3MgbGlrZSB0aGUgVGV4YXMgZGF0YSBmcm9tIDE5ODggd2FzIHJlbW92ZWQgZnJvbSB0aGUgZmlyc3Qgc3BsaXQuCgoKT0ssIHNvIG5vdyBsZXQncyBmaXQgb3VyIHBhbmVsIHJlZ3Jlc3Npb24gb24gdGhlIGZpcnN0IHN1YnNldCBvZiBkYXRhIGxpa2Ugd2UgZGlkIHByZXZpb3VzbHk6CgpgYGB7cn0KIHN1YnNldF8xX3Jlc3VsdDwtcGxtKFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgfgogICAgICAgICAgICAgICAgICAgICAgICBSVENfTEFXICsKICAgICAgICAgICAgICAgICAgICAgICAgV2hpdGVfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBCbGFja19NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIE90aGVyX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgVW5lbXBsb3ltZW50X3JhdGUgKwogICAgICAgICAgICAgICAgICAgICAgICBQb3ZlcnR5X3JhdGUgKyAKICAgICAgICAgICAgICAgICAgICAgICAgUG9wdWxhdGlvbl9sb2cgKyAKICAgICAgICAgICAgICAgICAgICAgICAgcG9saWNlX3Blcl8xMDBrX2xhZywKICAgICAgICAgICAgICAgICAgICAgICAgZGF0YSA9IERPTk9IVUVfc3Vic2V0c1tbMV1dLAogICAgICAgICAgICAgICAgICAgICAgIGluZGV4ID0gYygiU1RBVEUiLCJZRUFSIiksCiAgICAgICAgICAgICAgICAgICAgICAgbW9kZWwgPSAid2l0aGluIiwKICAgICAgICAgICAgICAgICAgICAgIGVmZmVjdCA9ICJ0d293YXlzIikKc3VtbWFyeShzdWJzZXRfMV9yZXN1bHQpCmBgYAoKSW5kZWVkLCB3ZSBjYW4gc2VlIHRoYXQgbm93IHdlIGhhdmUgYW4gdW5iYWxhbmNlZCBwYW5lbCB3aXRoIE4gPSAxMzk0IG9ic2VydmF0aW9ucyBpbnN0ZWFkIG9mIDEzOTUsIGFzIGV4cGVjdGVkLgoKTm93IHRoYXQgd2UgaGF2ZSBvdXIgc3Vic2V0cywgd2Ugd2FudCB0byB3cml0ZSBhIGZ1bmN0aW9uIHRvIGZpdCBhIHBhbmVsIHJlZ3Jlc3Npb24gdXNpbmcgYHBsbSgpYG9uIGVhY2ggc3Vic2V0cy4gU2VlIFt0aGlzIGNhc2Ugc3R1ZHldKGh0dHBzOi8vb3BlbmNhc2VzdHVkaWVzLmdpdGh1Yi5pby9vY3MtYmxvb21iZXJnLXZhcGluZy1jYXNlLXN0dWR5Lyl7dGFyZ2V0PSJfYmxhbmsifSAgZm9yIG1vcmUgaW5mb3JtYXRpb24gb24gd3JpdGluZyBmdW5jdGlvbnMuCgphdm9jYWRvIGFkZCBib290c3RhcnAgZGVzY3JpcHRpb24gbWF5YmUgbGluayBhYm91dCBjcm9zcyB2YWxpZGF0aW9uLSB0ZXN0aW5nIGFuZCB0cmFpbmluZyBzZXRzCgpgYGB7cn0KZml0X25sc19vbl9ib290c3RyYXBfRE9OT0hVRSA8LSBmdW5jdGlvbihzdWJzZXQpewogICAgICAgICAgICAgICAgICAgIHBsbShWaW9sX2NyaW1lX3JhdGVfMWtfbG9nIH4KICAgICAgICAgICAgICAgICAgICAgICAgUlRDX0xBVyArCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFVuZW1wbG95bWVudF9yYXRlICsKICAgICAgICAgICAgICAgICAgICAgICAgUG92ZXJ0eV9yYXRlICsgCiAgICAgICAgICAgICAgICAgICAgICAgIFBvcHVsYXRpb25fbG9nICsgCiAgICAgICAgICAgICAgICAgICAgICAgIHBvbGljZV9wZXJfMTAwa19sYWcsCiAgICAgICAgICAgICAgICAgICAgICAgIGRhdGEgPSBkYXRhLmZyYW1lKHN1YnNldCksCiAgICAgICAgICAgICAgICAgICAgICAgaW5kZXggPSBjKCJTVEFURSIsIllFQVIiKSwKICAgICAgICAgICAgICAgICAgICAgICBtb2RlbCA9ICJ3aXRoaW4iLAogICAgICAgICAgICAgICAgICAgICAgZWZmZWN0ID0gInR3b3dheXMiKQp9CgpgYGAKCk5vdyB3ZSBjYW4gYXBwbHkgdGhpcyBmdW5jdGlvbiB0byBlYWNoIG9mIG91ciBzdWJzZXRzIHNpbXVsdGFuZW91c2x5IHVzaW5nIHRoZSBgbWFwKClgIGZ1bmN0aW9uIG9mIHRoZSBgcHVycnJgIHBhY2thZ2UuICAKCmBgYHtyfQoKc3Vic2V0c19tb2RlbHNfRE9OT0hVRSA8LSBtYXAoRE9OT0hVRV9zdWJzZXRzLCBmaXRfbmxzX29uX2Jvb3RzdHJhcF9ET05PSFVFKQoKc3Vic2V0c19tb2RlbHNfRE9OT0hVRSA8LSBzdWJzZXRzX21vZGVsc19ET05PSFVFICU+JQogIG1hcCh0aWR5KQoKYGBgCgoKR3JlYXQhIE5vdyB3ZSB3YW50IHRvIGRvIHRoZSBzYW1lIHRoaW5nIGZvciB0aGUgTG90dCBkYXRhLgoKYGBge3J9CnNldC5zZWVkKDEyNCkKTE9UVF9zcGxpdHMgPC0gZF9wYW5lbF9MT1RUICU+JSBsb29fY3YoKQoKIyBUbyBnZXQgYWxsIHRoZSBkYXRhIHN1YnNldHM6CkxPVFRfc3Vic2V0cyA8LW1hcChwdWxsKExPVFRfc3BsaXRzLCBzcGxpdHMpLCB0cmFpbmluZykKYGBgCgoKV2UgbmVlZCB0byBjcmVhdGUgYSBkaWZmZXJlbnQgZnVuY3Rpb24gdG8gZml0IHRoZSBkYXRhIHRvIGFjY291bnQgZm9yIHRoZSBsYXJnZXIgbnVtYmVyIG9mIGRlbW9ncmFwaGljIHZhcmlhYmxlcy4gV2Ugd2lsbCB1c2UgdGhlIGZvcm11bGEgdGhhdCB3ZSBtYWRlIHByZXZpb3VzbHkuCgpgYGB7cn0KZml0X25sc19vbl9ib290c3RyYXBfTE9UVCA8LSBmdW5jdGlvbihzcGxpdCl7CiAgcGxtKExPVFRfZm1sYSwKICAgICAgZGF0YSA9IGRhdGEuZnJhbWUoc3BsaXQpLAogICAgICBpbmRleCA9IGMoIlNUQVRFIiwiWUVBUiIpLAogICAgICBtb2RlbCA9ICJ3aXRoaW4iLAogICAgICBlZmZlY3QgPSAidHdvd2F5cyIpCn0KCgpzdWJzZXRzX21vZGVsc19MT1RUIDwtIG1hcChMT1RUX3N1YnNldHMsIGZpdF9ubHNfb25fYm9vdHN0cmFwX0xPVFQpCgpzdWJzZXRzX21vZGVsc19MT1RUIDwtIHN1YnNldHNfbW9kZWxzX0xPVFQgJT4lCiAgbWFwKHRpZHkpCmBgYAoKTm93IHdlIHdpbGwgY29tYmluZSB0aGUgb3V0cHV0IHNvIHRoYXQgd2UgY2FuIG1ha2UgYSBwbG90IHRvIHZpc3VhbGl6ZSB0aGUgcmVzdWx0cyB0aGF0IHdlIG9idGFpbmVkLiBGaXJzdCBsZXQncyBuYW1lIGVhY2ggc3Vic2V0IHRoYXQgd2UgY3JlYXRlZC4KCmBgYHtyfQpuYW1lcyhzdWJzZXRzX21vZGVsc19ET05PSFVFKSA8LSAgICAgcGFzdGUwKCJET05PSFVFXyIsMTpsZW5ndGgoc3Vic2V0c19tb2RlbHNfRE9OT0hVRSkpCgpuYW1lcyhzdWJzZXRzX21vZGVsc19MT1RUKSA8LSAKcGFzdGUwKCJMT1RUXyIsMTpsZW5ndGgoc3Vic2V0c19tb2RlbHNfTE9UVCkpCgpgYGAKCk5vdyB3ZSBjYW4gY29tYmluZSB0aGUgdGliYmxlcyB3aXRoaW4gdGhlIGxpc3Qgb2YgdGliYmxlcyBmb3IgdGhlIGBzdWJzZXRzX21vZGVsc19ET05PSFVFYCBhbmQgYHN1YnNldHNfbW9kZWxzX0xPVFRgIGRhdGEuCgpUbyBkbyB0aGlzIHdlIHdpbGwgdXNlIHRoZSBgYmluZF9yb3dzKClgIGZ1bmN0aW9uIG9mIHRoZSBgZHBseXJgIHBhY2thZ2Ugd2l0aCB0aGUgYC5pZCA9ICJJRCJgIGFyZ3VtZW50LCB3aGljaCB3aWxsIGNyZWF0ZSBhIG5ldyB2YXJpYWJsZSBjYWxsZWQgYElEYCB0aGF0IHdpbGwgbGlzdCB0aGUgbmFtZSBvZiB0aGUgdGliYmxlIHRoZSBkYXRhIGNhbWUgZnJvbS4KClRoZW4gd2Ugd2lsbCBjb21iaW5lIHRoZSBkYXRhIGZyb20gYm90aCB0aGUgRG9ub2h1ZSBhbmQgTG90dCBzaW11bGF0aW9ucy4KCmBgYHtyfQoKc2ltdWxhdGlvbnNfRE9OT0hVRSA8LSBzdWJzZXRzX21vZGVsc19ET05PSFVFICU+JQogIGJpbmRfcm93cyguaWQgPSAiSUQiKSAlPiUKICBtdXRhdGUoQW5hbHlzaXMgPSAiQW5hbHlzaXMgMSIpCgpzaW11bGF0aW9uc19MT1RUIDwtIHN1YnNldHNfbW9kZWxzX0xPVFQgJT4lCiAgYmluZF9yb3dzKC5pZCA9ICJJRCIpICU+JQogIG11dGF0ZShBbmFseXNpcyA9ICJBbmFseXNpcyAyIikKCnNpbXVsYXRpb25zIDwtIGJpbmRfcm93cyhzaW11bGF0aW9uc19ET05PSFVFLAogICAgICAgICAgICAgICAgICAgICAgICAgc2ltdWxhdGlvbnNfTE9UVCkKCmhlYWQoc2ltdWxhdGlvbnMpCnRhaWwoc2ltdWxhdGlvbnMpCmBgYAoKTm93IHdlIHdpbGwgbWFrZSBhIGppdHRlciBwbG90IHVzaW5nIHRoZSBgZ2VvbV9qaXR0ZXIoKWAgZnVuY3Rpb24gb2YgdGhlIGNvZWZmaWNpZW50IGVzdGltYXRlcyBvZiB0aGUgYFJUQ19MQVdUUlVFYCB2YXJpYWJsZSBmb3IgZWFjaCBzaW11bGF0aW9uLgoKYGBge3J9CnNpbXVsYXRpb25fcGxvdCA8LSBzaW11bGF0aW9ucyAlPiUKICBmaWx0ZXIodGVybT09IlJUQ19MQVdUUlVFIikgJT4lCiAgZ2dwbG90KGFlcyh4ID0gQW5hbHlzaXMsIHkgPSBlc3RpbWF0ZSkpICsgCiAgZ2VvbV9qaXR0ZXIoYWxwaGEgPSAwLjI1LAogICAgICAgICAgICAgIHdpZHRoID0gMC4xKSArIAogIGxhYnModGl0bGUgPSAiQ29lZmZpY2llbnQgaW5zdGFiaWxpdHkiLAogICAgICAgc3VidGl0bGUgPSAiRXN0aW1hdGVzIHNlbnNpdGl2ZSB0byBvYnNlcnZhdGlvbiBkZWxldGlvbnMiLAogICAgICAgeCA9ICJUZXJtIiwKICAgICAgIHkgPSAiQ29lZmZpY2llbnQiLAogICAgICAgY2FwdGlvbiA9ICJSZXN1bHRzIGZyb20gc2ltdWxhdGlvbnMiKSArIAogIHRoZW1lX21pbmltYWwoKSArCiAgdGhlbWUoYXhpcy50aXRsZS54ID0gZWxlbWVudF9ibGFuaygpKQoKc2ltdWxhdGlvbl9wbG90CgpgYGAKCmZyb20gTWljaGFlbApgYGB7cn0Kc2ltcyA8LSAyNTAKCiMgRE9OT0hVRQpzYW1wc19ET05PSFVFIDwtIGxhcHBseShyZXAoZGltKERPTk9IVUVfREYpWzFdLTEsIHNpbXMpLAogICAgICAgZnVuY3Rpb24oeClET05PSFVFX0RGW3NhbXBsZShucm93KERPTk9IVUVfREYpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc2l6ZSA9IHgsIHJlcGxhY2UgPSBGQUxTRSksXSkKCmZpdF9ubHNfb25fYm9vdHN0cmFwX0RPTk9IVUUgPC0gZnVuY3Rpb24oc3BsaXQpewogIHBsbShWaW9sX2NyaW1lX3JhdGVfMWtfbG9nIH4KICAgICAgICAgICAgICAgICAgICAgICAgUlRDX0xBVyArCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFVuZW1wbG95bWVudF9yYXRlICsKICAgICAgICAgICAgICAgICAgICAgICAgUG92ZXJ0eV9yYXRlICsgCiAgICAgICAgICAgICAgICAgICAgICAgIFBvcHVsYXRpb25fbG9nICsgCiAgICAgICAgICAgICAgICAgICAgICAgIHBvbGljZV9wZXJfMTAwa19sYWcsCiAgICAgIGRhdGEgPSBkYXRhLmZyYW1lKHNwbGl0KSwKICAgICAgaW5kZXggPSBjKCJTVEFURSIsIllFQVIiKSwKICAgICAgbW9kZWwgPSAid2l0aGluIiwKICAgICAgZWZmZWN0ID0gInR3b3dheXMiKQp9CiAgCnNhbXBzX21vZGVsc19ET05PSFVFIDwtIGxhcHBseShzYW1wc19ET05PSFVFLCBmaXRfbmxzX29uX2Jvb3RzdHJhcF9ET05PSFVFKQoKc2FtcHNfbW9kZWxzX0RPTk9IVUUgPC0gc2FtcHNfbW9kZWxzX0RPTk9IVUUgJT4lCiAgbWFwKHRpZHkpCgpuYW1lcyhzYW1wc19tb2RlbHNfRE9OT0hVRSkgPC0gcGFzdGUwKCJET05PSFVFXyIsMTpsZW5ndGgoc2FtcHNfbW9kZWxzX0RPTk9IVUUpKQoKc2ltdWxhdGlvbnNfRE9OT0hVRSA8LSBzYW1wc19tb2RlbHNfRE9OT0hVRSAlPiUKICBiaW5kX3Jvd3MoLmlkID0gIklEIikgJT4lCiAgbXV0YXRlKEFuYWx5c2lzID0gIkFuYWx5c2lzIDEiKQoKIyMgTE9UVAoKc2FtcHNfTE9UVCA8LSBsYXBwbHkocmVwKHJvdW5kKGRpbShMT1RUX0RGKVsxXS8yKSwgc2ltcyksCiAgICAgICBmdW5jdGlvbih4KSBMT1RUX0RGW3NhbXBsZShucm93KExPVFRfREYpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc2l6ZSA9IHgsIHJlcGxhY2UgPSBGQUxTRSksXSkKCmZpdF9ubHNfb25fYm9vdHN0cmFwX0xPVFQgPC0gZnVuY3Rpb24oc3BsaXQpewogIHBsbShMT1RUX2ZtbGEsCiAgICAgIGRhdGEgPSBkYXRhLmZyYW1lKHNwbGl0KSwKICAgICAgaW5kZXggPSBjKCJTVEFURSIsIllFQVIiKSwKICAgICAgbW9kZWwgPSAid2l0aGluIiwKICAgICAgZWZmZWN0ID0gInR3b3dheXMiKQp9CiAgCnNhbXBzX21vZGVsc19MT1RUIDwtIGxhcHBseShzYW1wc19MT1RULCBmaXRfbmxzX29uX2Jvb3RzdHJhcF9MT1RUKQoKc2FtcHNfbW9kZWxzX0xPVFQgPC0gc2FtcHNfbW9kZWxzX0xPVFQgJT4lCiAgbWFwKHRpZHkpCgpuYW1lcyhzYW1wc19tb2RlbHNfTE9UVCkgPC0gcGFzdGUwKCJMT1RUXyIsMTpsZW5ndGgoc2FtcHNfbW9kZWxzX0xPVFQpKQoKc2ltdWxhdGlvbnNfTE9UVCA8LSBzYW1wc19tb2RlbHNfTE9UVCAlPiUKICBiaW5kX3Jvd3MoLmlkID0gIkFuYWx5c2lzIikgJT4lCiAgbXV0YXRlKEFuYWx5c2lzID0gIkFuYWx5c2lzIDIiKQoKc2ltdWxhdGlvbnMgPC0gYmluZF9yb3dzKHNpbXVsYXRpb25zX0RPTk9IVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICBzaW11bGF0aW9uc19MT1RUKQoKc2ltdWxhdGlvbl9wbG90IDwtIHNpbXVsYXRpb25zICU+JQogIGZpbHRlcih0ZXJtPT0iUlRDX0xBV1RSVUUiKSAlPiUKICBnZ3Bsb3QoYWVzKHggPSBBbmFseXNpcywgeSA9IGVzdGltYXRlKSkgKyAKICBnZW9tX2ppdHRlcihhbHBoYSA9IDAuMjUsCiAgICAgICAgICAgICAgd2lkdGggPSAwLjEpICsgCiAgbGFicyh0aXRsZSA9ICJDb2VmZmljaWVudCBpbnN0YWJpbGl0eSIsCiAgICAgICBzdWJ0aXRsZSA9ICJFc3RpbWF0ZXMgc2Vuc2l0aXZlIHRvIG9ic2VydmF0aW9uIGRlbGV0aW9ucyIsCiAgICAgICB4ID0gIlRlcm0iLAogICAgICAgeSA9ICJDb2VmZmljaWVudCIsCiAgICAgICBjYXB0aW9uID0gIlJlc3VsdHMgZnJvbSBzaW11bGF0aW9ucyIpICsgCiAgdGhlbWVfbWluaW1hbCgpICsKICB0aGVtZShheGlzLnRpdGxlLnggPSBlbGVtZW50X2JsYW5rKCkpCgpzaW11bGF0aW9uX3Bsb3QKYGBgCgojIyMgVklGCgpgYGB7cn0KZGVzaWduLm1hdHJpeCA8LSBhcy5kYXRhLmZyYW1lKG1vZGVsLm1hdHJpeChET05PSFVFX09VVFBVVCkpCgpkZXNpZ24ubWF0cml4JFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgPC0gcGxtOjpXaXRoaW4oCiAgZF9wYW5lbF9ET05PSFVFJFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cpCgpsbV9ET05PSFVFIDwtIGxtKFZpb2xfY3JpbWVfcmF0ZV8xa19sb2cgfgogICAgICAgICAgICAgICAgICAgICAgICBSVENfTEFXVFJVRSArICMgbG9naWNhbCBjbGFzcyBjaGFuZ2VzIHZhcmlhYmxlIG5hbWUgYWZ0ZXIgaW5pdGFsIG1vZGVsCiAgICAgICAgICAgICAgICAgICAgICAgIFdoaXRlX01hbGVfMTVfdG9fMTlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBXaGl0ZV9NYWxlXzIwX3RvXzM5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgQmxhY2tfTWFsZV8xNV90b18xOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIEJsYWNrX01hbGVfMjBfdG9fMzlfeWVhcnMgKwogICAgICAgICAgICAgICAgICAgICAgICBPdGhlcl9NYWxlXzE1X3RvXzE5X3llYXJzICsKICAgICAgICAgICAgICAgICAgICAgICAgT3RoZXJfTWFsZV8yMF90b18zOV95ZWFycyArCiAgICAgICAgICAgICAgICAgICAgICAgIFVuZW1wbG95bWVudF9yYXRlICsKICAgICAgICAgICAgICAgICAgICAgICAgUG92ZXJ0eV9yYXRlICsgCiAgICAgICAgICAgICAgICAgICAgICAgIFBvcHVsYXRpb25fbG9nICsKICAgICAgICAgICAgICAgcG9saWNlX3Blcl8xMDBrX2xhZywKICAgICAgICAgICAgIGRhdGEgPSBkZXNpZ24ubWF0cml4KQoKCnZpZihsbV9ET05PSFVFKQoKdmlmX0RPTk9IVUUgPC0gdmlmKGxtX0RPTk9IVUUpCgp2aWZfRE9OT0hVRSA8LSB2aWZfRE9OT0hVRSAlPiUKICBhc190aWJibGUoKSAlPiUKICBjYmluZCguLCBuYW1lcyh2aWZfRE9OT0hVRSkpICU+JQogIGFzX3RpYmJsZSgpCiAgCmNvbG5hbWVzKHZpZl9ET05PSFVFKSA8LSBjKCJWSUYiLCAiVmFyaWFibGUiKQoKbWF4X3ZpZl9ET05PSFVFIDwtIG1heCh2aWYobG1fRE9OT0hVRSkpIApgYGAKCmBgYHtyfQpkZXNpZ24ubWF0cml4IDwtIGFzLmRhdGEuZnJhbWUobW9kZWwubWF0cml4KExPVFRfT1VUUFVUKSkKCmRlc2lnbi5tYXRyaXgkVmlvbF9jcmltZV9yYXRlXzFrX2xvZyA8LSBwbG06OldpdGhpbigKICBkX3BhbmVsX0xPVFQkVmlvbF9jcmltZV9yYXRlXzFrX2xvZykKCkxPVFRfdmFyaWFibGVzX29scyA8LSBMT1RUX0RGICU+JQogIGRwbHlyOjpzZWxlY3QoUlRDX0xBVywKICAgICAgICAgICAgICAgIGNvbnRhaW5zKGMoIldoaXRlIiwiQmxhY2siLCJPdGhlciIpKSwKICAgICAgICAgICAgICAgIFVuZW1wbG95bWVudF9yYXRlLAogICAgICAgICAgICAgICAgUG92ZXJ0eV9yYXRlLAogICAgICAgICAgICAgICAgUG9wdWxhdGlvbl9sb2csCiAgICAgICAgICAgICAgICBwb2xpY2VfcGVyXzEwMGtfbGFnKSAlPiUKICBjb2xuYW1lcygpICU+JQogIHN0cl9yZXBsYWNlKCJSVENfTEFXIiwgIlJUQ19MQVdUUlVFIikgIyBsb2dpY2FsIGNsYXNzIGNoYW5nZXMgdmFyaWFibGUgbmFtZSBhZnRlciBpbml0YWwgbW9kZWwKCkxPVFRfZm1sYV9vbHMgPC0gYXMuZm9ybXVsYShwYXN0ZSgiVmlvbF9jcmltZV9yYXRlXzFrX2xvZyB+IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFzdGUoTE9UVF92YXJpYWJsZXNfb2xzLCBjb2xsYXBzZSA9ICIgKyAiKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICApCiAgICAgICAgICAgICAgICAgICAgICAgICkKCmxtX0xPVFQgPC0gbG0oTE9UVF9mbWxhX29scywKICAgICAgICAgICAgIGRhdGEgPSBkZXNpZ24ubWF0cml4KQoKdmlmKGxtX0xPVFQpCgp2aWZfTE9UVCA8LSB2aWYobG1fTE9UVCkKCnZpZl9MT1RUIDwtIHZpZl9MT1RUICU+JQogIGFzX3RpYmJsZSgpICU+JQogIGNiaW5kKC4sIG5hbWVzKHZpZl9MT1RUKSkgJT4lCiAgYXNfdGliYmxlKCkKICAKY29sbmFtZXModmlmX0xPVFQpIDwtIGMoIlZJRiIsICJWYXJpYWJsZSIpCgptYXhfdmlmX0xPVFQgPC0gbWF4KHZpZihsbV9MT1RUKSkKYGBgCgpgYGB7ciwgZWNobz1GQUxTRX0KI1RoaXMgY291bGQgYmUgdXNlZCB0byBsYWJlbCB0aGUgbWF4IFZJRiBvZiBlYWNoIGFuYWx5c2lzCgptYXhfdmlmX0RPTk9IVUUKbWF4X3ZpZl9MT1RUCmBgYAoKJCRcZnJhY3sxfXsxLVJfe2l9XnsyfX0kJAoKYGBge3J9CnZpZl9ET05PSFVFJEFuYWx5c2lzIDwtICJBbmFseXNpcyAxIgp2aWZfTE9UVCRBbmFseXNpcyA8LSAiQW5hbHlzaXMgMiIKCnZpZl9kZiA8LSByYmluZCh2aWZfRE9OT0hVRSwKICAgICAgICAgICAgICAgIHZpZl9MT1RUKQoKdmlmX3Bsb3QgPC0gdmlmX2RmICU+JQogIGdncGxvdChhZXMoeCA9IEFuYWx5c2lzLCB5ID0gVklGKSkgKwogIGdlb21faml0dGVyKHdpZHRoID0gMC4xLCBhbHBoYSA9IDAuNSwgc2l6ZSA9IDIpICsKICBnZW9tX2hsaW5lKHlpbnRlcmNlcHQgPSAxMCwgY29sb3IgPSAicmVkIikgKwogIHNjYWxlX3lfY29udGludW91cyh0cmFucyA9ICdsb2cxMCcsCiAgICAgICAgICAgICAgICAgICAgIGxpbWl0cyA9IGMoMSwxMDAwKSkgKwogIGxhYnModGl0bGUgPSAiVmFyaWFuY2UgaW5mbGF0aW9uIGZhY3RvcnMiKSArIAogIHRoZW1lX21pbmltYWwoKSArCiAgdGhlbWUoYXhpcy50aXRsZS54ID0gZWxlbWVudF9ibGFuaygpKQoKdmlmX3Bsb3QKYGBgCgojIFN5bnRoZXNpcwoKYGBge3IsIGZpZy5oZWlnaHQ9MTAsIGVjaG89RkFMU0UsIG1lc3NhZ2U9RkFMU0UsIHdhcm5pbmc9RkFMU0V9CnRpdGxlX3Bsb3RzIDwtIGdnZHJhdygpICsgCiAgZHJhd19sYWJlbCgKICAgICJNdWx0aWNvbGxpbmVhcml0eSBhbmQgaXRzIGVmZmVjdHMiLAogICAgZm9udGZhY2UgPSAnYm9sZCcsCiAgICBzaXplPTE4LAogICAgeCA9IDAsCiAgICBoanVzdCA9IDAKICApICsKICB0aGVtZSgKICAgIHBsb3QubWFyZ2luID0gbWFyZ2luKDAsIDAsIDAsIDApCiAgKQoKZm9yd2FyZCA8LSBnZ2RyYXcoKSArIAogIGRyYXdfbGFiZWwoCiAgICAiQW5hbHlzaXMgMTogNiBkZW1vZ3JhcGhpYyB2YXJpYWJsZXNcbkFuYWx5c2lzIDI6IDM2IGRlbW9ncmFwaGljIHZhcmlhYmxlcyIsCiAgICBmb250ZmFjZSA9ICdib2xkJywKICAgIHNpemU9MTAsCiAgICB4ID0gMCwKICAgIGhqdXN0ID0gMAogICkgKwogIHRoZW1lKAogICAgcGxvdC5tYXJnaW4gPSBtYXJnaW4oMCwgMCwgMCwgMCkKICApCgpjb3JyX21hdF9ET05PSFVFIDwtIGdnY29ycnBsb3QoY29yX0RPTk9IVUVfZGVtLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgdGwuY2V4ID0gNiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGhjLm9yZGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG91dGxpbmUuY29sb3IgPSAidHJhbnNwYXJlbnQiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY29sb3JzID0gYygicmVkIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIndoaXRlIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgInJlZCIpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbGVnZW5kLnRpdGxlID0gVGVYKCIkXFxyaG8kIikpICsKICB0aGVtZV92b2lkKCkgKyAKICB0aGVtZShwbG90LnRpdGxlPSBlbGVtZW50X3RleHQoc2l6ZT04KSkgKwogIGxhYnModGl0bGUgPSAiQW5hbHlzaXMgMSIpIAoKY29ycl9tYXRfTE9UVCA8LSBnZ2NvcnJwbG90KGNvcl9MT1RUX2RlbSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRsLmNleCA9IDYsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBoYy5vcmRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICBvdXRsaW5lLmNvbG9yID0gInRyYW5zcGFyZW50IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNvbG9ycyA9IGMoInJlZCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJ3aGl0ZSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICJyZWQiKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxlZ2VuZC50aXRsZSA9IFRlWCgiJFxccmhvJCIpKSArCiAgdGhlbWVfdm9pZCgpICsgCiAgdGhlbWUocGxvdC50aXRsZSA9IGVsZW1lbnRfdGV4dChzaXplPTgpKSArCiAgbGFicyh0aXRsZSA9ICJBbmFseXNpcyAyIikgCgpwbG90X0ExIDwtIGNvcnJfbWF0X0RPTk9IVUUKCnBsb3RfQTIgPC0gY29ycl9tYXRfTE9UVAoKcm93X0EgPC0gcGxvdF9ncmlkKHBsb3RfQTEsCiAgICAgICAgICAgICAgICAgICBwbG90X0EyLAogICAgICAgICAgICAgICAgICAgbnJvdyA9IDEpCgp0aXRsZV9BIDwtIGdnZHJhdygpICsgCiAgZHJhd19sYWJlbCgKICAgICJDb3JyZWxhdGlvbiBiZXR3ZWVuIHZhcmlhYmxlcyBjYW4gaW5kdWNlIG11bHRpY29sbGluZWFyaXR5IiwKICAgIGZvbnRmYWNlID0gJ2JvbGQnLAogICAgc2l6ZT0xNCwKICAgIHggPSAwLAogICAgaGp1c3QgPSAwCiAgKSArCiAgdGhlbWUoCiAgICBwbG90Lm1hcmdpbiA9IG1hcmdpbigwLCAwLCAwLCAwKQogICkKCmxlZ2VuZF9BIDwtIGdldF9sZWdlbmQoY29ycl9tYXRfTE9UVCkKCnBsb3RfQSA8LSBwbG90X2dyaWQodGl0bGVfQSwKICAgICAgICAgICAgICAgICAgICByb3dfQSwKICAgICAgICAgICAgICAgICAgICBuY29sID0gMSwKICAgICAgICAgICAgICAgICAgICByZWxfaGVpZ2h0cyA9IGMoMC4xLDEpKQoKZW1wdHlfZGYgPC0gY2JpbmQoYygxOjEwKSxjKDE6MTApKSAlPiUKICBhcy5kYXRhLmZyYW1lKCkKCmNvbG5hbWVzKGVtcHR5X2RmKSA8LSBjKCJYIiwgIlkiKQoKcGxvdF9CMSA8LSBnZ3Bsb3QoZW1wdHlfZGYsIGFlcyh4ID0gWCwgeSA9IFkpKSArCiAgYW5ub3RhdGUoInRleHQiLAogICAgICAgICAgIHg9NSwKICAgICAgICAgICB5PTUsCiAgICAgICAgICAgbGFiZWwgPSBUZVgoIiRWSUZfe2l9ID0gXFxmcmFjezF9ezEtUl97aX1eezJ9fSQiKSwKICAgICAgICAgICBzaXplID0gOCkgKwogIHRoZW1lX3ZvaWQoKQoKcGxvdF9CMiA8LSB2aWZfcGxvdCArCiAgdGhlbWUoYXhpcy50aXRsZS54ID0gZWxlbWVudF90ZXh0KHNpemU9OCkpCgpyb3dfQiA8LSBwbG90X2dyaWQocGxvdF9CMSwKICAgICAgICAgICAgICAgICAgICAgICBwbG90X0IyLAogICAgICAgICAgICAgICAgICAgICAgIG5yb3cgPSAxKQoKdGl0bGVfQiA8LSBnZ2RyYXcoKSArIAogIGRyYXdfbGFiZWwoCiAgICAiVmFyaWFuY2UgaW5mbGF0aW9uIGZhY3RvcnMgY2FuIGJlIHVzZWQgdG8gaWRlbnRpZnkgbXVsdGljb2xsaW5lYXJpdHkgd2hlbiBwcmVzZW50IiwKICAgIGZvbnRmYWNlID0gJ2JvbGQnLAogICAgc2l6ZT0xNCwKICAgIHggPSAwLAogICAgaGp1c3QgPSAwCiAgKSArCiAgdGhlbWUoCiAgICBwbG90Lm1hcmdpbiA9IG1hcmdpbigwLCAwLCAwLCAwKQogICkKCnBsb3RfQiA8LSBwbG90X2dyaWQodGl0bGVfQiwKICAgICAgICAgICAgICAgICAgICByb3dfQiwKICAgICAgICAgICAgICAgICAgICBuY29sID0gMSwKICAgICAgICAgICAgICAgICAgICByZWxfaGVpZ2h0cyA9IGMoMC4xLDEpKQoKcGxvdF9DMSA8LSBjb21wYXJpbmdfYW5hbHlzZXNfcGxvdCArIAogIHRoZW1lKGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KHNpemUgPSA4KSwKICAgICAgICBheGlzLnRpdGxlLnggPSBlbGVtZW50X2JsYW5rKCkpICsKICBsYWJzKHRpdGxlID0gIkludHJvZHVjZXMgYmlhcyB0byBlc3RpbWF0ZXMiLAogICAgICAgc3VidGl0bGUgPSAiQmlhcyBpbnRyb2R1Y2VkIGNhbiBjaGFuZ2UgZGlyZWN0aW9uIG9mIGVzdGltYXRlIikKCnBsb3RfQzIgPC0gc2ltdWxhdGlvbl9wbG90ICsKICBsYWJzKHRpdGxlID0gIlJlZHVjZXMgcHJlY2lzaW9uIGluIGVzdGltYXRlcyIpCgpyb3dfQyA8LSBwbG90X2dyaWQocGxvdF9DMSwKICAgICAgICAgICAgICAgICAgICAgICBwbG90X0MyLAogICAgICAgICAgICAgICAgICAgICAgIG5yb3cgPSAxKQoKdGl0bGVfQyA8LSBnZ2RyYXcoKSArIAogIGRyYXdfbGFiZWwoCiAgICAiTXVsdGljb2xsaW5lYXJpdHkgY2FuIGhhdmUgYSBuZWdhdGl2ZSBlZmZlY3Qgb24gc3RhdGlzdGljYWwgaW5mZXJlbmNlIiwKICAgIGZvbnRmYWNlID0gJ2JvbGQnLAogICAgc2l6ZT0xNCwKICAgIHggPSAwLAogICAgaGp1c3QgPSAwCiAgKSArCiAgdGhlbWUoCiAgICBwbG90Lm1hcmdpbiA9IG1hcmdpbigwLCAwLCAwLCAwKQogICkKCnBsb3RfQyA8LSBwbG90X2dyaWQodGl0bGVfQywKICAgICAgICAgICAgICAgICAgICByb3dfQywKICAgICAgICAgICAgICAgICAgICBuY29sID0gMSwKICAgICAgICAgICAgICAgICAgICByZWxfaGVpZ2h0cyA9IGMoMC4xLDEpKQoKcGxvdHMgPC0gcGxvdF9ncmlkKHBsb3RfQSwKICAgICAgICAgICAgICAgICAgIHBsb3RfQiwKICAgICAgICAgICAgICAgICAgIHBsb3RfQywKICAgICAgICAgIG5jb2wgPSAxLAogICAgICAgICAgcmVsX2hlaWdodHMgPSBjKDEsMSwxKSkKCm1haW5wbG90IDwtIHBsb3RfZ3JpZCh0aXRsZV9wbG90cywKICAgICAgICAgICAgICAgICAgICAgICBmb3J3YXJkLAogICAgICAgICAgICAgICAgICAgICAgIHBsb3RzLAogICAgICAgICAgICAgICAgICAgICAgICNsZWdlbmRfdXcsCiAgICAgICAgICAgICAgICAgICAgICAgbmNvbCA9IDEsCiAgICAgICAgICAgICAgICAgICAgICAgcmVsX2hlaWdodHMgPSBjKDAuMDUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDAuMDUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIDEpKQoKbWFpbnBsb3QKYGBgCgoKCmBgYHtyLCBlY2hvPUZBTFNFLCBpbmNsdWRlPUZBTFNFfQpnZ3NhdmUoaGVyZTo6aGVyZSgiaW1nIiwgIm1haW5wbG90LnBuZyIpKQpgYGAKCgoKCiMgKipEYXRhIFZpc3VhbGl6YXRpb24qKgoqKiogCgojICoqU3VtbWFyeSoqCioqKiAKCiMgKipTdWdnZXN0ZWQgSG9tZXdvcmsqKgoqKiogCgojICoqQWRkaXRpb25hbCBJbmZvcm1hdGlvbioqCioqKgoKIyMgKkhlbHBmdWwgTGlua3MKCgpbVGlkeXZlcnNlXShodHRwczovL3d3dy50aWR5dmVyc2Uub3JnLyl7dGFyZ2V0PSJfYmxhbmsifSAgCltXcml0aW5nIGZ1bmN0aW9uc10oaHR0cHM6Ly9yNGRzLmhhZC5jby5uei9mdW5jdGlvbnMuaHRtbCl7dGFyZ2V0PSJfYmxhbmsifSAgIApbTG9uZ2l0dWRpbmFsIHN0dWRpZXNdKGh0dHBzOi8vd3d3LmJtai5jb20vYWJvdXQtYm1qL3Jlc291cmNlcy1yZWFkZXJzL3B1YmxpY2F0aW9ucy9lcGlkZW1pb2xvZ3ktdW5pbml0aWF0ZWQvNy1sb25naXR1ZGluYWwtc3R1ZGllcyl7dGFyZ2V0PSJfYmxhbmsifSAgIApbUGFuZWwgZGF0YV0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvUGFuZWxfZGF0YSl7dGFyZ2V0PSJfYmxhbmsifSAgICAKW0NvbmZpZGVuY2UgaW50ZXJ2YWxzXShodHRwczovL2VuLndpa2lwZWRpYS5vcmcvd2lraS9Db25maWRlbmNlX2ludGVydmFsKXt0YXJnZXQ9Il9ibGFuayJ9ICAgCltMaW5lYXIgcmVncmVzc2lvbiBtb2RlbF0oaHR0cHM6Ly9lbi53aWtpcGVkaWEub3JnL3dpa2kvTGluZWFyX3JlZ3Jlc3Npb24pe3RhcmdldD0iX2JsYW5rIn0gICAKCkZvciBtb3JlIGluZm9ybWF0aW9uIG9uIGxpbmVhciByZWdyZXNzaW9uIHNlZSB0aGlzIFtib29rXShodHRwczovL3JhZmFsYWIuZ2l0aHViLmlvL2RzYm9vay9saW5lYXItbW9kZWxzLmh0bWwjbGluZWFyLXJlZ3Jlc3Npb24taW4tdGhlLXRpZHl2ZXJzZSl7dGFyZ2V0PSJfYmxhbmsifSBhbmQgdGhpcyBbY2FzZSBzdHVkeV0oaHR0cHM6Ly9vcGVuY2FzZXN0dWRpZXMuZ2l0aHViLmlvL29jcy1icC1kaWV0Lyl7dGFyZ2V0PSJfYmxhbmsifS4KCmF2b2NhZG8gZmlsbCB0aGlzIG91dAoKaHR0cHM6Ly9ycHVicy5jb20vcnNsYmxpc3MvZml4ZWRfZWZmZWN0cwoKaHR0cDovL2thcnRodXIub3JnLzIwMTkvaW1wbGVtZW50aW5nLWZpeGVkLWVmZmVjdHMtcGFuZWwtbW9kZWxzLWluLXIuaHRtbAoKaHR0cHM6Ly9zdGF0cy5zdGFja2V4Y2hhbmdlLmNvbS9xdWVzdGlvbnMvOTkyMzYvZWZmZWN0cy1pbi1wYW5lbC1tb2RlbHMtaW5kaXZpZHVhbC10aW1lLW9yLXR3b3dheXMKCiMjIEFja25vd2xlZGdlbWVudHMKCldlIHdvdWxkIGxpa2UgdG8gYWNrbm93bGVkZ2UgW0RhbmllbCBXZWJzdGVyXShodHRwczovL3d3dy5qaHNwaC5lZHUvZmFjdWx0eS9kaXJlY3RvcnkvcHJvZmlsZS83MzkvZGFuaWVsLXdlYnN0ZXIpIGZvciBhc3Npc3RpbmcgaW4gZnJhbWluZyB0aGUgbWFqb3IgZGlyZWN0aW9uIG9mIHRoZSBjYXNlIHN0dWR5LgoKV2Ugd291bGQgYWxzbyBsaWtlIHRvIGFja25vd2xlZGdlIHRoZSBbQmxvb21iZXJnIEFtZXJpY2FuIEhlYWx0aCBJbml0aWF0aXZlXShodHRwczovL2FtZXJpY2FuaGVhbHRoLmpodS5lZHUvKSBmb3IgZnVuZGluZyB0aGlzIHdvcmsuIAoK

Open Case Studies: Examination of Multicollinearity Influence on Inference Using Right-to-Carry Gun Law and Violent Crime Data

Michael Ontiveros, Carrie Wright, PhD.

Motivation

Main Question

Learning Objectives

Context

Limitations

What are the data?

Data Import

Demographic and population data

State FIPS codes

Police staffing data

Unemplyment data

Poverty data

Violent crime

Right-to-carry data

Data Wrangling

State FIPS codes

Demographic and population data

Combining demographic data

Combining population Data

Police staffing

Unemployment

Poverty rate

Violent crime

RTC laws

Joining Data

Donohue, et al.

Lott and Mustard

Data Exploration

Data Analysis

Donohue, et al.

Lott and Mustard

RTC coefficient comparison

Multicollinearity analysis

Correlation

Scatterplots

Heatmaps

Coefficient estimate instability

VIF

Synthesis

Data Visualization

Summary

Suggested Homework

Additional Information

*Helpful Links

Acknowledgements